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The Alberta Journal of Educational Research 
Vol. XVI, No. 1, March, 1971 


CHARLES E. PASCAL 
McGill University 


Instructional Options, Option Preference, 
and Course Outcomes! 


The effects of offering three instructional options to students (N=185)—lec- 
ture, lecture with discussing, and independent study—-were examined. Re- 
sults indicate that students who received their preferred method of in- 
struction showed a more positive attitude towards the course’s area than 
students assigned to non-preferred methods. Receiving one’s preferred op- 
tion had no significant effect on cognitive outcomes. Several significant 
main effects of the methods on the cognitive outcomes were obtained, how- 
ever. 


The need to adapt instruction to individual differences is recognized by 
many students, educational psychologists and teachers. Researchers, too, 
have studied the effects of different methods of teaching on different 
kinds of students. While the results have not shown startlingly large ef- 
fects, it still seems likely that some students benefit from methods of 
instruction ineffective for other students. Few studies (e.g. Haigh and 
Schmidt, 1956) have examined the effects of allowing students to choose 
and experience their preferred method of instruction. 

If one grants the premise that teaching methods are differentially ef- 
fective for different kinds of students, how can students be placed into 
classes where they will learn most effectively? 


In the absence of effective computer matching of students and teach- 
ing methods (Cronbach, 1967) the most realistic solution may be student 
self-selection. It is argued by many progressive educators as well as 
students that only the student can determine what educational experiences 
will be most meaningful to him as an individual. The present research 
was designed to put that assertion to the test. 


1 The author is grateful to Dr. W. J. McKeachie for his help in this research and valuable comments 
for the preparation of this paper. This paper was part ofa presentation made at the annual meeting 
of the American Educational Research Association, Minneapolis, March 4, 1970. 
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Problem 


This study investigated the effects of offering three instructional op- 
tions (lecture, lecture and discussions, and independent study) to stu- 
dents in a large lecture. In addition to studying whether or not students 
do better when given their preferred method of learning, the study in- 
vestigated the possible differential effectiveness of the three methods on 
different instructional outcomes. 


Hypotheses 

Hypotheses 1-3 deal with the effects of receiving ones’ preferred 
method of instruction while the latter three are concerned with the 
methods’ main effects on the course outcomes (e.g. cognitive and affec- 
tive measures). 


Hypothesis 1: Students who receive their preferred option will perform 
significantly better in the course (i.e., receive higher grades) than students 
who do not receive their first choice. 

Hypothesis 2: Students who receive their preferred option will indicate a 
more favorable attitude towards the course’s field than students who do not 
receive their first choice. 

Hypothesis 3: Students who receive their preferred option will rate the 
course as more valuable than students who do not receive their first 
choice. 

Hypothesis 4: Students in the lecture and lecture-discussion options will 
perform better on the knowledge and comprehension items on the criterion 
test than the independent study students. 

Hypothesis 5: Students in the lecture-discussion option and the indepen- 
dent reading option will perform better on the “application” part of the 
criterion test. 


Hypothesis 6: Independent reading students will be better at evaluating a 
novel reading. 


Procedures 
Subjects 


The subjects for the research were 185 students enrolled in “Socia- 
lization,” a Psychology course at the University of Michigan during the 
Spring Semester in 1969. 


Method 


Students were given the following descriptions of three instructional 
options and were asked to indicate their preferences for each: 

1. Independent Study 
Students in this method have an independent reading experience. 
Students are not expected to attend lectures and are not required 
to take examinations. The independent reading students are expect- 
ed to do considerably more reading (8-10 hours weekly) since they 
have more time available because they do not have to attend lec- 
tures. 
Each student works out his own reading program with the instruc- 
tor. This program is determined in part by the course syllabus and 
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in part by the student’s own particular interests. That is, the stu- 
dent is encouraged to explore readings in the library which are 
both relevant to the course and of interest to the student. 
Two written projects are required: 
a. Reading Log: 
Includes brief abstracts of the readings and more important in- 
cludes student’s personal comments, criticisms, applications, and 
evaluations of each reading. Students hand in the log twice dur- 
ing the semester for comments. 
b. Term Paper: 
A paper on any topic of the student’s choice. 
2. Lecture 
Students in this method take the course strictly as a lecture course. 
Students are expected to attend lectures and read the required 
material on the course syllabus. They take a midterm and final 
exam and write a term paper on the topic of their choice. 
3. Lecture and Discussion 
Students in this method also take a midterm and final exam and 
write a term paper. But, in addition, these students also attend a 
discussion group every other week (in addition to lectures). These 
student discussions are based mainly on the case material. There- 
fore, students should plan to do the appropriate reading before 
each discussion session to insure productive discussions. 


The students were told that they were participating in an evaluation 
of this instructional technique and that everyone would not be able to 
get their first choice. 


A minimum of fifty students were then assigned to each of the three 
instructional options. About one-half of each group were randomly assign- 
ed to the option which they listed as their first choice; the other half 
of each group found themselves randomly placed in an option which was 
either their second or third choice. Students who were placed in their 
first choice will be referred to as “Preferred” students and those who 
did not receive their first choice are labelled ‘““Non-preferred”’. 


Because an unequal number of students chose each of the options 
and because it was decided that, if possible, no student would be assig- 
ed an option he labeled “definitely not,’ it was difficult to obtain equi- 
valent sample sizes in each cell. Table 1 indicates the number of sub- 
jects by cells in the experimental design. 


Instruments 


Criterion Test. The criterion test used to measure cognitive achievement 
consists of two levels of items. Level I contains 31 items (112 points) and 
corresponds to items which measure Bloom’s (1956) Knowledge and Com- 
prehension objectives. Level II of the criterion test consists of 8 items 
(65 points) which measure Application of the course material. (The post- 
course form contained two additional items for this level.) Most of the 
items were drawn from the instructor’s previous exams while several 
were obtained from Carrier’s (1966) criterion test. 
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TABLE 1 


NUMBER OF SUBJECTS BY PREFERENCE IN EACH 
INSTRUCTIONAL OPTION 


aS 
« = —eeeeFlFleeeeeee Oe oom 


Instructional Option 


Independent Lecture 
Preference Study Lecture Discussion Totals 
First 
Choice of 44 25 106 
Not First 
Choice 8) ol 23 79 
Totals 60 igs: 50 185 


’ 


A key was developed for scoring the essay or “application” items as 
a result of consultation and discussion with the instructor regarding the 
objectives and correct answers for each item. The test was scored with- 
out the knowledge of students’ names and experimental status (code 
numbers were used throughout the study). A scoring-rescoring reliability 
was obtained from a sample of 20 tests and was found to be .98 (time 
between scorings was one week). 

It should be added that the post-course administration of the criterion 
test preceded the final exam in the course (for lecture, and lecture and 
discussion students) by three weeks. This was done to insure equivalent 
“preparation” for independent study students and the other students. At 
the time of the final administration of the criterion test, all relevant ma- 
terial should have been read or heard by students across all options. 
By using a “grade-free” criterion test which preceded preparation (by 
lecture, lecture-discussion students) for the final exam, it was hoped that 
the “preparation” and “motivational” factors would be the same for 
all groups. 


Attitude toward Psychology Questionnaire (Carrier, 1966). This question- 
naire is designed to measure the students’ attitude toward the field 
of Psychology and is composed of 20 Likert-type items. A pre- and 
post-course administration of this questionnaire was obtained and Ana- 
lysis of Covariance was used to measure the treatment and preference 
factor effects of the experimental course. 


Course Evaluation. This form contains many questions dealing with 
the students’ feelings and reactions toward the course regarding things 
such as their evaluation of the course’s activities, their intention to do 
additional reading in the area, their opinions about options, etc. 

Evaluation of a Novel Articles Students were given a seven page article 
toward the end of the semester and were given the following instructions: 
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This exercise is to be completed by all students and will be used for 
borderline cases in grading. Please read the following study and integrate 
what you have learned in the course into an evaluation of the study. That 
is, compare, contrast, and apply the various theoretical approaches and per- 
haps your own personal experience to an evaluation of the case. The 
exercise should be completed individually and should not exceed two type- 
written pages. Therefore, please organize your thoughts before typing your 
answer. It is to be handed in on the last day of classes, April 18th (Inde- 
pendent reading students hand it in with their final paper). 


This exercise was scored according to the student’s ability to address 
himself directly to an evaluation of the article; that is a student scoring 
an A characteristically brings in outside references and personal experi- 
ences when specifically relevant to an understanding of the case. In many 
cases an A evaluation concluded with appropriate recommendations 
and/or solutions to the problem. Students who presented an abundance 
of facts did not necessarily score high on this exercise; that is, some stu- 
dents used the case study as a vehicle for presenting much information 
whether relevant or not to the case. Therefore, succinct integration of 
course material was the essential criterion for an A score. Evaluations 
were scored on a three level scale: A, B. C. Scoring-rescoring reliability 
of .75 was obtained on a sample of twenty when anonymously scored; 
time between scoring periods was one week. 


Results 

The data reported in this section are results of two-way analysis of 
variance and covariance. The covariate design was used in three instances 
in which pre-course data were obtained. The F statistic testing the regres- 
sion of the pre-course scores on the post-course was significant (p < .01) 
in each case substantiating the use of this design. 

Grades. No significant main effects or interactions were obtained for 
grades in the course. Hence, Hypothesis 1 must be rejected. 


Attitude towards Psychology. A significant main effect of the prefer- 
ence factor on attitude towards Psychology was obtained as noted in 
Table 2. Students in the “preferred” group indicated a more positive at- 
titude towards Psychology than those in the “non-preferred’ groups; 
therefore, Hypothesis 2 is supported. 


Value of the Course. No significant main effects or interactions were 
obtained for this outcome; therefore, Hypothesis 3 must be rejected. 

Knowledge and Comprehension of Course Material. As Table 3 indi- 
cates, a significant main effect of option assignment on knowledge and 
comprehension of course material was obtained. Students in the lecture- 
discussion and lecture option performed better, on this outcome, than 
independent study students thus supporting Hypothesis 4. 

Application of Course Material. No significant findings were obtained 
with respect to this outcome; therefore, Hypothesis 5 must be rejected. 

Evaluation of a Novel Article. Table 4 reports a significant main ef- 
fect of option assignment on this outcome: the independent study students 
scored better than did those students in the other two options. 


C. Pascal 


TABLE 2 


ATTITUDE TOWARDS PSYCHOLOGY 


(Two-way analysis of covariance) 


Source of Variation D.F. M.S. F Sig. 
Options my 59.16 1.33 ns 
Preference Factor 1 306.97 6.92 O1* 
Interaction oe 10.73 0.24 ns 
Error (within cells) 125 44.35 


*Estimate of Main Effects of Preference Factor: 


Preferred Non-Preferred 
1.5540429 -1.5540429 


Students who scored high on this exercise were more apt to address 
themselves to an evaluation of the article bringing in relevant read- 
ings and personal experience to illustrate their points. They were also 
more succinct and indicated that more organization preceded the final 
writing of their reaction report. These data support Hypothesis 6. Many 
students, however, used the article as a vehicle for presenting the basic 
concepts of some or all of the theorists dealt with in the course. In many 
cases, much course knowledge was presented but was relatively indepen- 
dent of an evaluation and solution of the article’s material. 


TABLE 3 


KNOWLEDGE AND COMPREHENSION OF COURSE MATERIAL 


(Two-way analysis of covariance) 


Source of Variation D.F. MS. F. Sig. 
Options 2 1156.52 24.98 {001% 
Preference Factor 1 80.05 172 ns 
Interaction 2 4.54 0.00 ns 
Error (within cells) 125 46.29 

*Estimate of Main Effects of Options: 
Ind. Study Lecture Lec-Discussion 
-5.8420937 1.9681104 3.8739833 
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For this reason, the articles were recoded and were scored for the 
amount of course knowledge presented in the reaction reports. The find- 
ings (Table 5) of this analysis indicate that both lecture and lecture- 
discussion students used significantly more course knowledge in their 
evaluations (p < .01) than independent study students (scoring reliability 
was .83). Thus, there was a distinct difference in the way students in the 
independent study option and those in the other two options dealt with 
this particular assignment: independent study students paid more at- 
tention to an evaluation of the article, were more succinct in their reports, 
and brought in theoretical support when it was needed to explain a point, 
whereas students in the other two options used the assignment to pre- 
sent as much course knowledge as possible. 


TABLE 4 


EVALUATION OF A NOVEL ARTICLE 
(Two-way analysis of variance) 


Source of Variation D.F. M.S. F. Sig. 
Options 2 5.06 Last GL =** 
Preference Factor 1 1.65 3.84 ns 
Interaction Zz 0.38 0.88 ns 
Error (within cells) 146 0.43 


Mean Scores 


Ind. Study Lecture Lec.Dics. 


Preferred 


Non-Preferred 


aoe 1.93 > 2.56 & 2.40 2.30 
(grand Mean) 


*Margins indicate one-way means; Scoring key: 1=A, 2=B, 3=C. 


Additional Outcomes. In addition to these major outcomes, several 
other significant findings are worth mentioning. Non-preferred inde- 
pendent study students rated the course more difficult and anxiety pro- 
voking (p< .01) than students who preferred this option. 

Independent Study students rated the term paper assignment more 
favorably (p< .01) than students in the other two methods. They also 
reported that they did more “non-required” work than lecture and _ lec- 
ture-discussion students (p < .01). 

In response to the items “Course has caused me to be more creative 
than I normally am,” and “Course has been flexible enough to allow me 
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TABLE 5 


NOVEL ARTICLE: SCORED FOR KNOWLEDGE 
(Two-way analysis of variance) 


Source of Variation D.F. M.S. F. Sig. 
Options 2 8.20 14.72 OTStee 
Preference Factor if Zile 3.86 ns 
Interaction 2 0.46 0.82 ns 
Error (within cells) 146 0.55 


Mean Scores 
Ind. Study Lecture  Lec-Disc. 


Preferred 


Non-Preferred 


hades 2.63 > 1.82 & 2.08 2.18 
(grand mean) 


*Margins indicate one-way means; Scoring key: 1=A, 2=B, 3=C. 


to pursue my own goals”, Independent Study students reflected signifi- 
cantly greater agreement with the item than students in the other options. 

Students were generally in favour of having options (93.5 per cent 
positive, 6.5 per cent indifferent) and the majority reported that options 
provided them with “freedom and individualization” (91.6 per cent). Nega- 
tive comments concerned the inability to change options (35.1 per cent) 
and the chance of not obtaining the requested option. 

Students were asked to rate their agreement with several statements 


concerning the use of options. The mean ratings for each of these state- 
ments is reported in Table 6. 


Discussion 


Does it make any difference whether or not a student is given his 
choice of methods of teaching? The results of the present investigation 
revealed no differences in achieving the course’s cognitive goals as a 
function of receiving or not receiving one’s preferred option; and only 
one affective outcome was influenced by this factor: students receiving 
their first choice showed a more positive attitude towards psychology 
than students who did not receive their first choice. With respect to 
grades, course evaluation, and other outcomes, no differences were found 


(with the exception of difficulty of the course and anxiety within the 
independent study method). 
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TABLE 6 
STUDENT OPINIONS ABOUT OPTIONS 
(N=172) 
Mean Ratings* Opinions 
1.78 A student can choose an option which best fits his particular 
style of learning and therefore performs better. 
1.87 If possible, all courses should offer options. 
2:15 A student increases his commitment to do the course work by 


being allowed to choose an option and therefore performs better 
in the course. 

See The more interesting the course, the less need for options. 

3:23 It doesn’t make much difference what method or option is avail- 
able for a course, good students will perform just as well when 
not given a choice as they would if given one. 


strongly agree 
strongly disagree 


*Scoring Key: 1 
6 


Perhaps one of the main reasons why more differences were not 
found due to the preference factor had to do with the instructor in the 
experimental course, who was well-liked. Student comments suggested 
that her lectures caused some to change their minds as to which option 
they preferred. By the same token, several students who had preferred 
the lecture but were assigned to the independent study control group 
reported that they had “come to prefer the independent study” option. 
Of the students responding to the phrase “The worst thing about op- 
tions .. .”, 35.1 per cent reported that “being stuck with your choice when 
you find out that you’d rather be in another option.” This suggests that 
students do not always know the option with which they will be most 
pleased; but this also suggests that perhaps students should be given 
a brief opportunity to alter their original choices to eliminate this prob- 
lem or perhaps be exposed to each option for a short period of time. 


The study also lends support to the notion that instructional methods 
are differentially compatible with course goals. For example, it has been 
shown that recall of knowledge is facilitated by the lecture and that 
evaluation of a novel article is better taught by the independent study 
method. 


In addition to cognitive outcomes, an instructor may have affective ob- 
jectives which are more compatible with one method than another. 
Although the study revealed few overall differences in achieving the 
course’s affective goals, it is still very possible that methods do differ 
with respect to promoting certain affective goals. For instance, assume 
that an instructor would like his students to be more independent in 
pursuing knowledge as a result of his course. Intuitively, it would seem 
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TABLE 7 
SUMMARY OF FINDINGS 


2 


Outcomes Findings* 


A. Knowledge and Comprehension of 


Course Material L&L-D> I(p <.001) 


B. Application of Course Material ns: 
C. Evaluation of a Novel Reading I >L-D & L(p <.01) 
D. Grades ns 
E. Attitudes towards Course’s Field Po NE (pou) 
F. Rated Value of Course ns 
G. Novel Reading: Scored for 
Knowledge L&L-D >I (p <.01) 
H. Difficulty of Course INP: IP: (py. 00) 
I. Anxiety in Course INE o> LP pee 00) 
J. Value of Term Paper I >L&L-D(p <.01) 
K. Non-Required Work I>L & L-D (p <.001) 
L. Rated Course Flexibility I>L&L-D (p< .001) 
M. Rated Course’s Influence on 
Creativity I>L&L-D(p <.01) 
*Key: I = Independent Study 
L = Lecture 
L-D = Lecture & discussion 
P = Preferred (students who received 


preferred option) 
NP = Non-Preferred 


most likely that the independent study option, in which the students 


may be reinforced for independent behavior, would be most compatible 
with achieving this objective. 


In summary, the present study suggests that students were in favour 
of having a choice of options and that they sometimes made “bad” choices; 
but whether or not an instructor makes use of options must depend on 
his course objectives and the priorities of these objectives. If the in- 
structor’s primary goal is to have the students be pleased with the op- 


portunity to choose their own method of learning then offering options 
can be an end in itself. 


If his only major goal is to develop independent thinking then perhaps 
he should have all of his students exposed to independent study. Instruc- 
tors vary greatly according to the types of objectives they have, and the 
extent to which they consider the personal goals of their students in plan- 
ning their courses. There can be no doubt that an instructor who offers 
different options is allowing students a greater opportunity to pursue 
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what they think are their own goals or optimal ways of learning; but at 
the same time, other goals may be sacrificed. It is therefore important 
that an instructor accept or reject, and design and evaluate, options with 
these priorities in mind. 


References 


Atkinson, J. W., & Litwin, G. H. Achievement motive and test anxiety conceived 
as a motive to approach success and motive to avoid failure. Journal of Ab- 
normal Social Psychology, 1960, 60, 52-63. 

Bloom, B.S. (Ed.) Taxonomy of educational objectives, handbook I: Cognitive domain. 
New York: McKay Col., 1956. 

Carrier, N. A. Evaluation of the introductory psychology course. Reading, Mass.: 
1966. 

Cronbach, L. J. The two disciplines of scientific psychology. American Psychologist, 
1957, 12, 671-684. 

Cronbach, L. J., How can instruction be adapted to individual differences. in R. 
Gagne (Ed.) Learning & individual differences. Charles E. Merrill Publishing 
Co., 1967. 

Dubin, R., & Taveggia, T. The teaching-learning paradox: A comparison analysis 
of college teaching. Eugene, Ore.: CASEA, 1968. 

Haigh, G. V., & Schmidt, W. The learning of subject matter in teacher-centered 
and group-centered classes. Journal of Educational Psychology, 1956, 47, 
295-301. 

Hays, W. L. Statistics for psychologists. New York: Holt, Rinehart, and Winston, 
Inc., 1963. 

Koenig, K., & McKeachie, W. J. Personality and independent study. Journal of 
Educational Psychology, 1959, 50, 132-134. 

McKeachie, W. J. Research on teaching at the college and university level. Chapter 
23 in Gage, N. L. (Ed.), Handbook of research on teaching. Chicago: Rand 
McNally, 1963. 

McKeachie, W. J. Motivation, teaching methods, and college learning. In M. R. 
Jones (Ed.). Nebraska symposium on motivation. Lincoln, Neb.: University 
of Nebraska, 1961. 

McKeachie, W. J. New developments in teaching. U.S. Dept. of Health, Education, 
and Welfare, 1967. 

Siegel, L., & Siegel, L. C. A multivariate paradigm for educational research. Psy- 
chological Bulletin, 1967, 68, 306-326. 

Winer, B. J. Statistical principles in experimental design. New York: McGraw- 
Hill, 1962. 

Wispe, L. G. Evaluating section teaching methods in the introductory course. 
Journal of Educational Psychology, 1951, 45, 161-186. 


11 


san i 


7 Tyne 
oy a 


: ; aa iy ; : 
| je Sat Saint We caw lace aban, sine wh om ri WAY gs 
a eee 7 ub oBlauges | twortnee ad “ant ie mh % Ho T 
: a " : y . 
oe ' oA « rai) an uy kta va i, iva a e )epge: 
| beviaet wi 
“ 7 son le 
| ] { i f 
uM 
- Laat ed and 
4! ixcumveictot 4 0) aren aw ‘i 
‘ Ps a 1 \ ‘ Pe \Wia4 ri A 4 w ri kau 7 
—_—. 
d A } ravgacal ‘(a ad er a> - 
e ‘ : 
of : v 
Ne eAly a ah OF boi * 08 
‘ ud ‘ as 
i y 1 > oF ( at t 
preys 
j 1% ‘| j | | 5 en i, 
f n PaaS 5 i 
i ‘ 
| W's AS Ar sregety 5 ty Aa avr Me im 
' | ve 4D ANS. Sah atl ae Edd ih 


Ty ie tet ate avai he diontedj tien 
\ , i ieh? ap 14 "ae 


pow’. i. polio ‘ bo 

AaT) OP RACE Seaver e iets 
iS cats wi fy belt Wee | ry acleeend Al a 2 pte 
an ee ba heat i, Wesel aay a‘ AY mae 
he Sidhe: ive) fi Ved 

ie? . 7" \ , fi GRR: (pai a wy an f 


au WV b } ‘ Tt ae vigil ory 0 TN it rte ray A 
j ‘a Dace a . ee 


vit me arn ) i ; " ivy een ) ‘ fee a“ : 4 | *w VW 


‘ . “7 Py A is 
i ~ | od ‘ ’ A “42 “vP ries, ¥ 
Feeen  -< ; é > ‘a je wg Bibb « 


>in adits aul Vw oy eo al 
epee) ere ee ae 7 
ue vee aaa 


7 


The Alberta Journal of Educational Research 
Vol. XVII, No. 1, March, 1971 


A.B. HERMAN 
The University of Calgary 


Effects of High School Program 
Choice on Self-Concept 


The purpose of this study was to determine if there was a difference 
*between the self-concept and the ideal self-concept in matriculation and 
non-matriculation students. A 5l-item Q sort was administered to 305 
Grade Ten students twice—once for determining actual self and once for 
ideal self. Variance of scores obtained showed no significant differences 
in self-concept between matriculation and non-matriculation students. Some 
differences occured with sex and intelligence groups. Individual item ana- 
lysis indicated Ss chief concerns were with appearance and attitude of 
others. 


No one is born with the self-he-becomes already predetermined. George 
Herbert Mead (1934) stated that the self is something which has a develop- 
ment. William James (1892), one of the earliest of the western world 
psychologists to concern himself with the subject of self, offered the view 
that the self is the function of the process of man’s interaction with his 
environment. It is only within a social matrix, within the field of the 
social act, that the self arises. Each individual within a comparatively 
short time after birth has developed a large number of perceptions about 
himself. These perceptions of self are referred to as self-concept or actual 
self. The sum of the characteristics of self which the person feels are 
necessary to attain adequacy is called ideal self. This is the view an in- 
dividual has of himself as he wishes to be. Bills, et al. (1951) define 
personal maladjustment as any discrepancy between the concept of actual 
self and the concept of ideal self. When an individual can make an 
overall evaluation of self and feel he is achieving basic need-satisfaction, 
he has attained self-adequacy and can move toward self-actualization. 

The self-concept affects personal, academic and vocational growth 
within the school. Quinley (1967) showed that the student with an ade- 
quate self-concept, feeling that he can succeed, will put forth the neces- 
sary academic effort; however, the student with an inadequate self-con- 
cept, feeling that he cannot succeed, will not put forth the necessary 
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academic effort to achieve in school. Anderson and Olsen (1965) indicated 
that a high correlation between a person’s appraised self and ideal self 
is concomitant with successful school adjustment and acceptance by 
others. Chambers and Lieberman (1965) reported that individuals with 
negative self-concepts made inadequate vocational choices. 

Education should be a means which brings about a greater congru- 
ence between the student’s self-concept and his ideal self-concept; that 
is, between how the student perceives himself and how he would like to 
be. To provide for individual differences, a variety of programs and a 
multiplicity of courses are offered to today’s high school students. In 
providing this wide range of offerings, educators hope to achieve more 
readily the basic purpose of schools—that of self-actualization for each 
individual student. 


Do many students entering high school desire to take a specific pro- 
gram but find they are not able to meet its entrance requirements? Do 
students in one program feel inferior to those in another program? 
Are students setting unrealistic goals for themselves? If answers to these 
questions are affirmative, then it could follow that, through selection of 
programs and courses, students are hindered from moving toward ful- 
filling their potential. 


The Problem 


The purpose of this study was to determine if there was a differ- 
ence between the self-concept and the ideal self-concept in matricula- 
tion and non-matriculation students. Other variables investigated as pos- 
sible causal effectors of differences between self-concept and ideal self: 
concept were sex of students, age, and intelligence. 


Sample 


Three hundred and five Grade Ten students were used in this study. 
The sample included 166 males and 139 females. The Ss ranged in age 
from 14 years 3 months to 19 years 0 months. Intelligence scores, in 
the form of percentiles, were recorded from Grade IX Departmental 
examination results. The total number of students having written the 
Ability Test for the year of this study exceeded 25,000. The spread in 
intelligence of the 305 Ss ranged from the first to the ninety-ninth per- 
centile. One hundred seventy-four Ss were enrolled in a matriculation 
program, while 131 were enrolled in non-matriculation programs—voca- 
tional, business or general. 


Method 


A 5l-item Q sort was used in the study. The items were drawn from 
a list of 100 self-referent statements developed by Butler and Haigh 
(1954), categorized according to a design originated by Stephenson (1952) 
and modified by Herman (1968). Samples of items included: “I am usual- 
ly happy,” “I get embarrassed easily’, “I think clearly’, “I worry about 
my health,” and “I am as clean and neat as most people.” The Q sort 
was administered twice, approximately one week apart. On the first sort, 


approximately one-half of the Ss (Group A) were asked to sort for actual 
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self, i.e, how they perceived themselves. The second half of the -Ss 
(Group B) were asked to sort for ideal self, i.e., how they would like 
to be. On the second administration Group A sorted for ideal self and 
Group B for actual self. 


Because measuring devices such as Q sort and various inventories are 
subject to social biases and piling of ratings at the favorable end of 
the scale, a check must be made to account for the social desirability 
factor. For this reason the Personality Research Form AA was admini- 
stered to all the Ss. 


The 51 statements of the Q sort were sorted into a forced distribution 
of 11 categories with the following number of statements in each category 
1-2-4-6-8-9-8-6-4-2-1. Values assigned to the categories ranged from 0 to 
10. The absolute differences between the actual self and the ideal self 
for the 51 items yielded a discrepancy score for each student. That is, 
when statement 1 was placed in category 4 in the actual sort and in 
category 9 in the self sort, the discrepancy score for that itme was 5. 
The total of the absolute differences for each of the 51 items provided 
the discrepancy score for one S. A t test was used to ascertain whether 
significant differences existed between mean discrepancy scores for the 
matriculation group (M) and for the non-matriculation group (NM). 


Findings 

Results of comparsions made of various subject groups are shown in 
Table 1 below. 

A t value of 0.95 indicated that there was no significant difference in 
discrepancy scores of matriculation and non-matriculation Ss in relation 
to self-concept. No significant differences were found when female Ss 
of M and NM were compared. Similar results were obtained upon com- 
parison of the male Ss of M and NM. 


Somewhat different results are indicated when the sexes were com- 
pared in each of the two groups. Although no significant differences 
were found between males and females within the M, significant differ- 
ences did occur within the NM as a result of comparison of male and 
female Ss. 

No significant differences occured as a result of differences of age 
groups in either M or NM; however, significant differences did occur 
within both the M and NM with different intelligence levels. 

Results from the Personality Research Form AA indicated that Ss 
scoring either high or low on the Desirability Scale had mean discrepan- 
cy scores on the Q sort that were not significantly different from the 
mean discrepancy scores of all the Ss in the study negating the factor 
of social desirability. 

In analyses of differences of means for self-concept and ideal self- 
concept for both M and NM, it was noted that those statements which 
showed the largest discrepancy scores were similar for both groups. 
Similarly, statements showing the smallest discrepancy scores were com- 
mon to both M and NM. A marked correlation between M and NM of 
68 existed for the 51 items, indicative of consistency in differences of 
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TABLE 1 


DIFFERENCES IN SELF AND IDEAL SELF 


ee 


Mean Discrepancy 


Subjects N Score t Value 

Matriculation 174 88.88 
Non-Matriculation 131 90.96 0.95 
Female M 81 90.10 

Male M 93 87.82 0.81 
Female NM 58 94.97 

Male NM 73 87.78 vA hs 
Female M 81 90.10 

Female NM 58 94.97 152 
Male M 93 87.82 

Male NM a 87.78 0.01 
Above average intelligence M 91 87.29 

Average intelligence M 78 91.90 1.36 
Above average intelligence M 91 87.29 

Below average intelligence M 5 81.80 2.46* 
Average intelligence M 78 91.90 

Below average intelligence M a 81.80 1.48 
Above average intelligence NM 3 117.67 

Average intelligence NM 76 88.99 2.89* 
Above average intelligence NM 3 Od 

Below average intelligence NM 52 92.31 DAS ey 
Average intelligence NM 76 88.99 

Below average intelligence NM 52 92.31 1.00 
Above median age M 87 88.52 

Below median age M 87 89.24 0.26 
Above median NM 65 90.20 

Below median NM 66 Oi 0.39 

*p< .05 


self and ideal self scores between M and NM. This is indicated in 
Table 2. 


Other results indicated in Table 2 show high correlations of the in- 
dividual items for the groups being compared. 
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TABLE 2 
Q SORT INTER-ITEM CORRELATIONS 


es Se 2 ee eS ee ee ee ee ee 
————— 


Subjects N Difference of Mean Self Pearson r 
and Mean Ideal Self 
Matriculation 174 2.64 
Non-Matriculation 131 -1.91 .68 
Male M 93 1:45 
Female M 81 0.57 91 
Male NM 13 -0.77 
Female NM 58 0.48 82 
Female M 81 0.57 
Female NM 58 0.48 .90 
Male M 93 1.43 
Male NM 13 =0.77 .78 
Discussion 


Underlying the pursuit of this investigation was the assumption that 
the school plays a role in determining a student’s percept of himself. 
If the school is serving equally all students according to their needs and 
abilities, then the students can develop to their highest potential. The 
ideal role that students feel they desire can be realized. Thus, disparities 
between self-concept and ideal self-concept should be no greater for one 
group of students than for another. 

For this sample the data indicate that one high school program is 
neither superior nor inferior in the development of self-concept. One 
cannot, therefore, assume that a high school matriculation program will 
significantly improve the self-concept of all students; nor can one assume 
that students who indicate greater congruence with relation to actual 
self and ideal self will elect a matriculation program. It would appear that 
in order to accommodate all individuals, our education system must allow 
a pluralistic approach for the attainment of ideals. 

Upon examination of individual statements from the 5l-item Q sort 
it is noted that Ss’ main concern is with their appearance. Items such 
as “I am good looking,” “I am happy about my weight,” and “I have 
poor skin,” received high priority for the ideal self sort. Also of concern 
is their reaction to others. They strive to adjust to what embarrasses 
them and to overcome a reaction that reflects that their feelings have 
been hurt. The attitude of the peer group, as well as significant others, 
appears to be of great importance to them. The Ss want to be worth- 
while members of a group. Again, such items as “I get embarrassed 
easily,” “My feelings are easily hurt,’ and “I am clumsier than most 
people,” were items indicative of largest discrepancy. 
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Although no significant difference between self-concept and ideal self- 
concept for the female and male M was shown, a significant differ- 
ence did appear between the male and female NM. Of greatest concern 
to the female NM were body and bodily processes (weight problems, 
appearance) as well as relationship problems which could lead to nervous- 
ness, hurt feelings and embarrassment. Male NM were concerned with 
progress in school and personal appearance. 


Some differences did occur with Ss of different intelligence groups. 
These may have been due to the relatively small number constituting 
the various intelligence level groups. Within the NM of 131 Ss, there 
were only three Ss that were classed as above average in intelligence. 
Similarly, within the M, only five of 174 Ss were classified in the be- 
low-average group. . 

If the addition of non-matriculation programs to school curricula 
shows no deleterious effects to students’ self-perception and at the same 
time serves other educational functions, more exploration may be desir- 
able in curriculum making to determine whether implementation of ad- 
ditional programs could be of benefit to students. 
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Value Orientations in an Indian Community 


Educational histories of the majority of children of Indian ancestry in 
North America reveal a low level of school achievement, by white standards, 
and early drop-out. This study, using the theory and method of F. Kluck- 
holn for identifying and comparing value orientations, sampled 138 Indian 
pupils, 30 Indian parents, and 129 teachers and administrators in a northern 
Canadian school system. Highly significant differences in value orientations 
were found between Indian and non-Indian samples in the Relational 
value orientation area, together with a number of similarities. Differences 
were also found between Treaty and Metis pupils. The findings hold im- 
portant implications for curriculum and program development. 


Although the subject of value or values has been the concern of 
axiologists for many centuries, a bewildering array of definitions and 
descriptions is found in philosophical and other literature. Few would 
disagree, however, with Lepley’s assertion (1957: 3) that the nature and 
status of value is one of the basic issues for survival today. Jacob, 
Flink and Shuchman (1962), in an interesting and comprehensive review 
of the concepts of value, note the wide variety of definitions. Moore, 
for example, states that values are as indefinite as is the term “good,” 
whereas Dewey suggests that “immediate likings or emotive expressions 
present themselves as candidates for value status” (p. 17). 

Wright suggests (1963: 10) that value concepts seem to form triples 
of two value absolutes at each end with one value between them. Ruesch 
(1957: 27) distinguishes between four categories of value: preferential 
behavior, anticipatory behavior, efficacious behavior, and price. Such 
categories lead to a consideration of the difference between beliefs, 
attitudes and values. Clyde Kluckhohn (1951: 390) comments on the 
“voluminous and often vague and diffuse literature on the subject,” but 
detects, in a survey of definitions, agreement that values refer to nor- 
mative rather than existential propositions. 

Each authority consulted seems to coin his own definitions, and many 
then proceed to construct instruments to measure whatever term was 
used at the outset. 
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For purposes of the study reported here, attitudes were taken to mean 
a state of readiness to respond, to refer to the individual, not the ob- 
ject, and to exclude imputations of the desirable. Beliefs were considered 
to be those phenomena which are accepted by the individual as real or 
possible, true or false, correct or incorrect, without necessarily being ac- 
companied by objective evidence or a commitment to action. Values, fol- 
lowing the definition proposed by Jacob et al. (1962: 10), were con- 
sidered to be “the normative standards by which human beings are in- 
fluenced in their choice among the courses of action which they per- 
ceive. 


Measurement of Values or Value Orientations 


In recent years, a number of social scientists have attempted to mea- 
sure values or value orientations, both across and within cultures. Morris 
(1956), using his “Ways to Live” instrument, tested 5,568 college students 
in China, India, Japan, Norway, Canada and the United States. He 
found, among many other things, that Asiatic peoples are more tolerant 
of cultural diversity between groups than are Western peoples. However, 
the Western groups tolerate more individual or psychological diversity 
than do the Asiatic groups. Dahlke (1958) has developed a typology of 
value orientations under the rubrics religious, nativist, market, common 
man, and humanist. Von Mering (1961) posited and tested a theory con- 
taining thirty-six value categories in four realms of value experience. In 
two communities in the Southwestern United States he discovered 
prominent diverging value drifts, value clusters, and strong evidence of 
the complexity of the valuing process. 

Foster, Katz and Otto (1966) used one open-ended question with a 
sample of teachers, parents and pupils in four communities in the United 
States. A content analysis of the answers produced a typology of fifty 
values in twelve value clusters. Raths (1966) emphasized the matter of pro- 
cess in valuing, and identified three: choosing, prizing, and acting. Con- 
cepts which other authorities label “values” he classifies as ‘‘value in- 
dicators.” A strong component in Raths’ theory is the use with pupils 
in schools of a list of thirty “clarifying questions” or of a “value sheet’, 
in order to help them identify their own values. 

In testing twelve value scales with fraternity and sorority members 
at the University of Colorado, Scott (1965) found, among many things, 
that greater homogeneity of values existed among sorority members than 
among fraternity members, and that the normative pressures of a frater- 
nity house did not, over time, cause younger members to adopt the values 
of the older members. Scott defines a value as 

. an individual’s concept of an ideal relationship (or state of affairs) 
which he uses to assess the “goodness” or “badness,” the “rightness” or 

“wrongness,” of actual relationships that he observes or contemplates. 

(p. 3). 

Rokeach (1968: 159-60) proposes that values may be either terminal, 
referring to desirable end-states of existence, such as “peace,” or instru- 
mental, referring to desirable modes of conduct, such as “generosity.” 


Testing of his theory has produced evidence of strong regional differences 
in values in the United States. 
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The Kluckhohn Theory of Value Orientations 


Florence Kluckholn (1961, 1963) has developed a theory of value 
orientations, and a method of testing for variations in such orientations. 
Kluckhohn conceives value orientations as complex, patterned principles 
resulting from the interplay of cognitive, affective and directive elements 
in the evaluative process. This transactional process, it is held, gives order 
and direction to human acts and thoughts in relation to what are termed 
“common human problems.” Table 1 shows the problems, phrased as 
questions, and the title of the value orientation “area” used to describe 
the problem. 


TABLE 1 
COMMON HUMAN PROBLEMS AND VALUE ORIENTATION AREAS* 


Problem Value Orientation 
Area 


1. What is the modality of man’s relations 


to other men? Relational 
2. What is the temporal focus of life? Time 
3. What is the relation of man to nature? Man-Nature 
4. What is the modality of human activity? Activity 
5. What is the character of innate human nature? Human-Nature 


*Adapted from Kluckhohn (1968, p. 222). 


The five problems tentatively singled out by Kluckhohn are not thought 
to be exhaustive, but to present a first statement, capable of expansion 
and refinement. A crucial part of the theory holds that the anwers to the 
problems are not random nor limitless, but fall into definite, rank-ordered 
patterns with three possible positions, reminiscent of Wright’s triples 
(1963: 10). Kluckhohn’s formulation of the possible range of value 
orientations is set forth in Table 2. 

A brief explanation of some of the terms in Table 2 may assist in 
discussion of the findings. In the Relational area, Lineality stresses the 
primacy of group goals continuous through time, as in hereditary and 
kinship structures such as aristocracies. Collaterality emphasizes the 
primacy of the goals of the laterally-extended immediate group; discon- 
tinuity in group allegiance is possible. Individualism centers on the process 
of individual goal-setting with little reference to lineal or collateral groups. 
Concepts in the Time area appear self-explanatory to those cultures which 
have a linear concept of time. 

In the Man-Nature area, Subject-to-Nature implies fatalism. Harmony- 
with-Nature implies no real separation of man, nature and super-nature 
(the Creator, if you wish). A concept of wholeness springs from this orien- 
tation. Mastery-over-Nature describes the view that natural forces of all 
kinds are to be overcome and put to the use of mankind. 
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TABLE 2 


KLUCKHOHN’S VALUE ORIENTATION AREAS AND RANGE OF VALUE 
ORIENTATION POSITIONS POSSIBLE IN EACH AREA 


Sa eaeEaa aaa SERRE SSR ASE EES ASE SE LS ih ie a ea EF oases) SEE ET A! 
ee ea ee ee 
i ap an ans ee eae 


Value Orienta- Range of Possible Value Orientation Positions 

tion Area 

Relational Lineality _ Collaterality Individualism 

Time Past Present Future 

Man-Nature Subject-to- Harmony-with- Mastery-over- 
Nature Nature Nature 

Activity Being Being-in- Doing 

Becoming 


Neutral:Mixture 
Human Nature Evil of Good and Evil Good 


Mutable-Immutable Mutable-Immutable Mutable-Immutable 


NOTE—Since each of the orientations is considered to be independently vari- 
able, the arrangement in columns of sets of orientations is only accidental. Any 
orientation can appear in any column. 


In the Activity area, Being is an orientation favoring the spontaneous 
expression of that which is conceived to be “given” in the personality; 
it is not license. Being-in-Becoming is a developmental orientation, display- 
ing the desire to improve what is “given” in the personality. A Doing 
orientation focuses on activity measurable in terms of standards outside 
the person himself. 


Discussion of the terms in the Human-Nature area is not necessary 
here, as the area was not tested in the study being reported here. 


Kluckhohn’s Methodology 


The methodology for testing the value orientation patterns is to pre- 
sent a simulated real-life situation, and ask for the respondent’s views as 
to who had the best and next-best idea. An example of an item follows. 

Wage Work 


Three men were talking about three different ways of working. Each 
man had a different idea. 


—_______A One said, “I like being my own boss, and doing things my 
way. Then I can decide what to do, start when I like, and 
stop when I like, and work as hard or as long as I like.” 
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—___B The second man said, “I like to work for a big company where 
I get paid regular wages and where I have a general idea 
of how many hours a day I will work, and what will be 
expected of me.” 

C A third man said, “I like to work with a friend or several 
friends. We would work together as equal partners and de- 
cide what to do among ourselves.” 

Which man do you think had the best idea? 

Which man had the next best idea? 


The rankings of all items are summed and patterning tested by the 
use of Kendall’s “S” (1962), binomial analysis as outlined by Kluckhohn 
and Strodtbeck (1961: 130-32), and the “Distance” concept proposed 
by Caudill and Scarr (1962). By the use of these methods, it becomes 
possible to compare one three-position pattern with another, as whole 
configurations, rather than emphasizing only the dominant or first-order 
preferences. Kluckhohn considers examination of the total patterning 
a crucial part of the theory, as the ranking of second and third-order 
preferences sheds much additional light on the differences between cul- 
tures and upon the process of cultural change. 


Kluckhohn’s theory and method were first tested in New Mexico, 
where, in a radius of twenty-five miles, five distinctive cultures can be 
found. Results of the “Five Cultures Study” (Kluckhohn and Strodtbeck, 
1961) demonstrated that the theory and method could discriminate 
among the value orientations of different cultures, using relatively small 
samples. 


Values and the Education of Indian 
Children in North America 


In the four hundred seventy-nine years since Columbus stumbled upon 
North America, relationships between the white man and those whom 
he called Indians could be described as notably uneasy. This, in spite 
of Columbus’ report to Ferdinand and Isabella in 1493 that the Indians 
demonstrated “great friendliness’ and “excellent and acute under- 
standing” (Montagu, 1965: 24). If this was an accurate observation, 
it becomes difficult to explain Indian wars, rebellions and uprisings, 
the continued social dependence of the Indian people, and the low edu- 
cational achievement (by white standards) of Indian pupils in formal 
educational systems. 


In a recent intensive study in Canada, Hawthorn (1967) states: 


Retention in Grade one and the loss of students in any twelve-year 
period are alarming. In a period of twelve years, 8441 Indian students 
out of 8782 did not complete high school. (p. 130). 


Similar findings have been presented regularly by other investigators 
such as Lagasse (1959); Knill and Davis (1967); Buckley, Kew and 
Hawley (1963); Card, Hirabayashi and French (1963); Wax and Wax 
(1964); and Fisher (1969). 

A number of explanations are commonly put forward for the low 
achievement of Indian pupils, compared with their non-Indian peers. 
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One of these has been termed the “language barrier,” a reference to 
the dual problem of children commencing school with little or no know- 
ledge of English, and of the different thoughtways of different languages. 
This is a highly relevant part of the problem. 

Many teachers have suggested that Indian children are genetically 
less intelligent than others. Some support for this viewpoint is provided 
by Jensen (1969: 52), although the issue is clouded by loose use of 
the word “disadvantaged.” A different kind of evidence is presented 
in compelling form by MacArthur (1968), who reports, after extensive 
and thorough use of various instruments for measuring intelligence, 
that on some types of ability tests, Indian Metis children perform better 
than their urban, non-Indian counterparts. 


Another hypothesis concerning the lower school achievement of 
Indian children is said to be “lack of motivation.” The counter-argument 
holds that this lack of motivation is caused by a conflict between middle- 
class, white values and Indian values. It is reasoned that the explicit 
and implicit values of teachers and the standard curriculum repel the 
Indian child and cause him to lose interest in school and leave as soon 
as he can do so. 


The Northern Schools Study 
Problem 


The study reported in this paper was an attempt to identify and 
measure, by the Kluckhohn theory and method, the value orientations 
of Indian and white cultures in northern Alberta, and to determine 
whether or not value conflicts do, in fact, exist between the cultures. 
The study was carried out in Northland School Division #61 in the 
province of Alberta, Canada (Gue, 1967). Northland Division serves all 
pupils in the isolated, forested area of the province, an area populated 
largely by people of Indian ancestry. 


Method 


A pilot study was conducted with thirty-five graduate students in 
Educational Administration at The University of Alberta; twenty-five 
Indian pupils and nine Indian parents in the rural hamlet of Calling 
Lake, Alberta; and seventy-five teachers in an urban school system in 
Alberta. As a result of the pilot study, two forms of the Kluckhohn in- 
strument were developed. The first, for pupils and parents, was printed 
and also recorded in the Cree language for those parents preferring 
a Cree version. A parallel form of the instrument was developed for 
the use of teachers and administrators in the school division. 


The samples consisted of 138 pupils, aged twelve and upwards, 
and thirty parents, all in the settlements of Wabasca and Desmarais, 
Alberta, and 129 teachers and administrators in Northland School Divi- 
sion. The instruments were administered by the investigator to the 
pupils and parents in Wabasca-Desmarais, and explained and distri- 
buted to the staff of the Division at its annual convention. 


Data were analyzed to identify and compare the value orientation 
patterns of parents, pupils, and teachers and administrators according 
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to certain criterion variables. Only the major findings are reported in 
this paper. 


“Treaty,” “Non-treaty,” and “Metis” Status 


For purposes of clarity in analyzing the data of the study, the dis- 
tinction between Indian persons who are “Treaty,” ‘Non-Treaty,” 
and “Metis” should be clearly understood. The history of these and re- 
lated common terms follows. 


Between August 3, 1871 and June 27, 1921, eleven major “treaties” 
were signed between certain Indian tribes of Canada and the Govern- 
ment of Canada (The Provincial Committee on Minority Groups, 1961). 
These treaties guaranteed certain rights to the Indian people who signed, 
including the establishment of reservations, provisions of educational 
services, “treaty money’, hunting rights on Crown land, and a number 
of other matters. Such rights are passed down through male succession 
only, and continue to this day for about half of the people of Indian 
ancestry resident in Canada. Those Indian people and their offspring 
who did not sign treaty, those females who married out of treaty, and 
those who chose to legally remove themselves from ‘Registered Indian” 
status are known variously as non-Treaty Indians, Metis, or Half-Breeds. 
In many places in northern Alberta Treaty and Metis people live side 
by side, the Metis usually clustering on the borders of the reservation. 

With the exception of the section analyzing differences between 
Treaty and Metis pupils, the term “Indian” as used in this paper re- 
fers to Treaty, Non-Treaty and Metis as one group. 


Findings 
The value orientation profiles of parents, pupils and teachers will 


be found in Table 3, using the symbolic notation developed by Kluck- 
hohn and Strodtbeck (1961: 131-32). 


Discussion 

Several general observations can be made about the findings. The 
first is that the data clearly indicate the inaccuracy of common stereo- 
types of the values of the Indian people. Indian parents and pupils 
demonstrated a Future orientation in the Time area, and a self-develop- 
mental (Being-in-Becoming) orientation in the Activity area. In addition, 
Indian parents displayed a preference for a Mastery-over-Nature orien- 
tation in the Man-Nature area. 

A second general observation is the fact that pupils differed marked- 
ly from both parents and teachers in the Man-Nature area, displaying 
a strong patterning of Subject-to-Nature as their dominant orientation. 
Possibly this reflects a combination of feelings of powerlessness stem- 
ming from sociocultural conditions in Indian settlements, together with 
typical adolescent anxieties and frustrations. 

A third general observation is that the congruence of total pattern- 
ing in the Indian parents’ sample and the teachers’ sample in three out 
of the four area (Time, Man-Nature and Activity) indicates a strong 
possibility for co-operation between Indian and non-Indian people in 
attempting to solve socio-cultural problems. 
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TABLE 3 


VALUE ORIENTATION PATTERNS OF PARENTS, PUPILS, 
AND TEACHERS IN NORTHLAND SCHOOL DIVISION #61 


Value 

Orientation Parents Pupils Teachers 

Area 

Relational Lin >Coll=*Indiv Lin > Coll > Indiv Indiv>Lin>Coll 
Time Fut = Pres > Past Fut >Pres >Past Fut > Pres >Past 


Man-Nature Mast=Harm>Subj Subj >Mast >Harm Mast > Harm > Subj 


Activity Bc= Doing > B Bc= Doing >B Bc > Doing >B 


NOTE—The abbreviations are read as follows: Lin—Lineality; Coll—Collatera- 
lity; Indiv—Individualism. Fut—Future; Pres—Present; Mast—Mastery-over-Nature; 
Harm—Harmony-With-Nature; Subj—Subject-to-Nature; B—Being; Bc—Being-in-Be- 
coming; D—Doing. 

*The symbol2 indicates that the difference in preference between: these two 
value orientation positions failed to reach the .05 level of statistical significance. 


The symbol > indicates that the preference between the two positions reached at 
least the .05 level of statistical significance. 


A fourth, and undoubtedly the most culturally significant finding 
of the whole study, is the wide divergence between Indian and non- 
Indian value orientations in the Relational area. It will be noted that 
both Indian parents and pupils ordered their preferences as Lineality 
preferred over Collaterality preferred over Individualism (L7C?>\I), 
whereas the teachers and administrators preferred Individualism over 
Lineality over Collaterality (I> L>C). Kluckhohn (1963: 239) discusses 
a similar situation with regard to the Spanish-American people of New 
Mexico, using this as an illustration of the hypothesis that a demand 
upon a culture for too rapid a shift in value orientation patterns (e.g. 
placing a third-order preference in a first-order position) produces 
acute social and personality disorganization. Kluckhohn states that 
of the four value-orientation areas, (Relational, Time, Man-Nature and 
Activity), the Relational area is the most significant in producing 
stresses between cultures. Clearly, then, in northern Alberta, a school 
curriculum and teacher value orientations with a powerful preference 
for Individualism may be expected to continue to produce intense stresses 
within Indian pupils and parents who place Individualism in a low 


third-order preference position. These might be termed external 
stresses. 
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Another observation concerning the stresses produced by value 
orientation patterning centers around the “goodness-of-fit”, concept 
proposed by Kluckhohn (1963: 226). This concept suggests that there 
should be a “strain towards consistency,” present in the linking of the 
value orientation areas of a culture if the culture is to function relatively 
smoothly. For example, Individualism “fits,” with a Future, Mastery- 
over-Nature, and Doing Orientation. In the Indian parent sample in this 
study, the mix of Lineality, Future, Mastery-over-Nature and Being-in- 
Becoming is a “bad fit,” which could help to explain the social and 
personal disorganization reported as present in Indian communities. 
The pupil sample betrays an equally inconsistent nature in the attempt 
to blend orientations of Lineality, Future, Subject-to-Nature and Being- 
in-Becoming. The stresses present in these ‘goodness-of-fit,’ incon- 
sistencies might be termed internal stresses. 


Value Orientations of Treaty and Metis Pupils 


A frequent point of discussion in the education of Indian children 
revolves around the possible differences in value orientations between 
Treaty and Metis children. Table 4 shows the results for both groups 
of pupils for items in the Relational and Time value orientation areas. 
Table 5 compares the two groups in the Man-Nature and Activity areas. 


Discussion 

Table 4 clearly shows that important differences exist in the crucial 
Relational area. Treaty pupils placed Individualism in _ third-order 
position, but Metis pupils tentatively advanced it to a second-order po- 
sition, and their total patterning was much less decisive than that of 
the Treaty pupils. 


In the Time area, although the final patterning of both samples was 
rank-ordered in the same manner, the indecisiveness of the Metis pupils 
came through quite clearly, as did different orderings in three indivi- 
dual items. 

Table 5 shows considerable congruence between Treaty and Metis 
pupils in the Man-Nature area, although the indecisiveness of the Treaty 
pupils is noticeable in the total patterning, compared with the deci- 
sive fatalism of the Metis pupils in their first-order preference for Sub- 
ject-to-Nature. 


In the Activity area, however, the Metis pupils tentatively put a 
Doing orientation in first place, whereas the Treaty pupils placed 
Being-in-Becoming first. For both samples, however, the Being orienta- 
tion was a clear last choice. 

In summary, it will be noted that Treaty and Metis pupils differed 
in their dominant preferences in five out of twenty-four items, and in 
their second-order preferences in three other items. Total area patterns 
differed in two of the four areas. These differences were of sufficient 
magnitude to reject the view that no difference exists between Treaty 
and Metis value orientations. 

It can be remarked that the combination of preferences for Doing 
and Individualism found in the Metis sample would be described as 
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TABLE 4 


VALUE ORIENTATIONS OF TREATY AND METIS PUPILS 
AGED TWELVE AND UPWARDS IN THE RELATIONAL 


AND TIME AREAS 
Item Treaty Pupils Metis Pupils 
Relational Area . 
1. Choice of Delegate Con an Tee te 
7. Help in Misfortune To eae Ll ae 
11. Allocation of Recreation Grant CN baie eb CS oe 315 
14. Wage Work [Lhe tC i Las Glen 
15. Family Work Relations Cen ev) GS eat 
18. Welfare Assistance Laer be © or ee 
21. Dropping Out of School [biog ok Ce = al | bir ie 
Area Pattern pS Co Shi LZ © 
Time Area 
3. Child Training PS PU Ps FP APs 
5. Expectations for Change Be ea Pa 7P = F 
10. Philosophy of Life Ko>sPo aha F >, P 2 Pa 
17. Ceremonial Innovation Be bo eube Pi-2 ite Pa 
19. Going Away to School E> Po Pa Fi-?eP 20a 
24. Sudden Prosperity Pas Ser PP aa 
Area Pattern ty uP ica hie ee La 


NOTE—Abbreviations in this table are read as follows: 


L—Lineality F—Future 
C—Collaterality P—Present 
I—Individualism Pa—Past 


a “good fit,” in the Kluckhohn theory. It follows that Metis pupils could 
be considered to have greater potential as change agents than Treaty 
pupils. 


Patterning and Age of Pupils 

In the Relational area, a most significant finding emerged in the 
total pupil sample, grouped according to age. For one year, at age 
fourteen, pupils moved Individualism from third- to second-order 
position. Younger and older pupils left it in a third-order position. This 
leads to speculation that for one year, close to the legal school-leaving 
age, Indian pupils were “trying out” white values—and rejected them. 
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TABLE 5 


VALUE ORIENTATIONS OF TREATY AND METIS PUPILS 
AGED TWELVE AND UPWARDS IN THE MAN-NATURE 


AND ACTIVITY AREAS 
Item Treaty Pupils Metis Pupils 
Man-Nature Area 
2. Length of Life SoM > Soa Mee 
6. Facing Conditions Oh Mas Sua Bet M 
9. Belief in Control Ht 2M HS 2M 
12. Use of the Environment M.> HS Me Hes 
22. Hunting, Fishing and Trapping Mee Sie Mies Sian 
Area Pattern S 22 oMe- S == Mee. H 
Activity Area 
4. Job Choice Be>B>D Be. BueeaD 
8. Ways of Living Bes D*S-B Be:>yD <2 ,B 
13. Housework D> Be> B De abo Gb 
16. Non-Working Time Be > Do >)B Be Dab 
20. Women in the Modern World Bes Die> BE D> Be B 
Area Pattern Bee D> _ EG D2) Bes B 


NOTE—Abbreviations in this table are read as follows: 


S—Subject-to-Nature B—Being 

M—Mastery-Over-Nature Bc—Being-in-Becoming 

H—Harmony-With-Nature D—Doing 
Implications 


If the findings of this study represent a sampling of the differences 
in value orientations between the Indian people and the dominant 
Canadian society, powerful implications emerge for curriculum objec- 
tives, teacher education, guidance services, and educational admini- 
stration. 


Statements of the objectives of education usually contain covert 
or overt support for the value of individualism in life. Guidance and 
counselling services stress the importance of individual differences, 
and use a variety of techniques (many of which are culturally-biased) 
to establish the differences. Educational services are organized and 
administered in such a way as to separate or “stream” pupils accord- 
ing to presumed abilities in our individualistically-oriented culture. 
The highest rewards of the system are usually given to those who set 
and achieve high academic goals for themselves. 


For the Indian child, achieving high academic goals may mean 
intellectual, physical and emotional separation from his parents, family 
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and culture. This a high price to pay in a culture where loyalties 
are still to the lineal group, not to individual success. The escape route 
for the Indian child seems to be to drop out of school and avoid the 
pressures of individualism. And what is true of the Indian child may 
also be true of the children of other cultures, frequently in crowded 
urban settings. 

The study reported here indicates that a close examination of cur- 
riculum objectives and of the administration of educational services 
is needed, within some systematic theory of values or value orienta- 
tions. The theory used might be that of Kluckhohn Rokeach, Raths, or 
other authorities in the field. Perhaps it would not be inappropriate to 
conduct the examination through several of the microscopes now 
available. 
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Of Significant and Important Differences! 


One of the criteria that must be observed in the selection of a research 
topic is that the answer to the problem must be based on empirical data. 
There may be a tendency, however, to restrict researchable problems to 
those that could be analyzed with inferential statistical techniques. Examples 
show that investigators may be led to contradictory conclusions when these 
are based merely on statistical inferences. This is particularly true with 
the Fisherian approach. Unless or until researchers are ready to use the 
Neyman-Pearson or Bayesian approaches, it may be preferable to analyze 
data with descriptive statistics. 


Introduction 

Give a small boy a hammer, and he will find that everything he encounters 

needs pounding (Kaplan, 1964: 28). 

One of the main criteria that a student or scholar must observe in the 
selection of a research topic is that the question be researchable, i.e., 
that the answer be based on empirical data (Davitz & Davitz, 1967: 
3-4). If one looks at the content of introductory courses in research it 
seems that a very large proportion of time is given to the understanding 
of inferential statistical techniques. It is as if these techniques were 
sine qua non conditions of a researchable question. In discussing their 
fifth criterion in the evaluation of a research plan, Davitz & Davitz de- 
fine researchable questions mainly in terms of empirical observations. 
However, in their guide concerning the appropriateness of statistical 
description and analysis they appear to place a restriction on the cri- 
terion of a researchable question by insisting on the importance of in- 
ferential statistical techniques (Davitz and Davitz: 27). 

Do these techniques “provide a clearcut basis for answering the re- 
search question posed?” (Davitz and Davitz, 1967: 27) Further, if the 


1 The author wishes to thank Dr. Robert Bryce of the Department of Educational Administration at 
The University of Alberta for his valuable assistance in the revision of the written English of 
this article. 
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answer is clear-cut, what does it mean exactly? Stated somewhat dif- 
ferently—to form the basic problem discussed in this paper—does a signifi- 
cant difference mean an important difference or does the term significant 
have the same meaning in both statistical and non-statistical context.? 
Or, to use Clark’s terminology (1963: 467-68) “What is the difference 
between statistical significance and substantive significance?” 


Purpose of Statistical Tests 


What is the purpose of a statistical test? In general, its purpose is 
to find out whether a statement about one or more parameters, or the 
null hypothesis, can be rejected or not. This decision is usually reached 
after the application of a statistical test to data consisting of a sample 
of observations drawn from a given population. 


For example, suppose an investigator is interested in finding out 
whether a given group of students, say the entire population of students 
of The University of Alberta, have a different I.Q., as measured by a given 
instrument, than another group of students, say the entire population of 
students of the University of Calgary. In view of the fact that for practi- 
cal purposes it may not be possible to test all students, the investigator 
draws a sample of students at random from each group and administers 
his instrument on these two samples. He then calculates the mean I.Q. 
in each group (hereafter referred to as X, and X,) and with the help 
of a statistical test tries to find out whether the mean I.Q. (hereafter 
referred to as U, and U,) in each population is unlikely to be the same. 
More precisely he attempts to ascertain whether the null hypothesis, that 
the mean I.Q. (U,) of the entire population of the first group (all the 
U. of A. students) is equal to that (U,) of the entire population of the 
second group (U of C), can be rejected at a given probability level of 
significance. If the null hypothesis is rejected, i.e., if there is a signifi- 
cant difference between X, and X,, the investigator may conclude that 
U, is most likely different than U,. 


Statistical and Substantive Significance 


Special attention should be given to the last statement. If the dif- 
ference between X, and X, (the sample means) is statistically significant, 
it does not necessarily follow that the difference between U, and U, 
(the population means) is meaningful, important, substantive, or signifi- 
cant in the usual sense of the term. It merely means that U; is most 
likely different than U;; it does not indicate to what extent the popula- 
tion means differ. 


The difficulties involved in the testing of the null hypothesis were 
illustrated over thirty years ago by Berkson in his remarks on the applica- 
tion of the chi-square test. As he observed, since a large sample is pre- 
ferable to a small one, and since the probability of rejecting the null 
hypothesis increases as the sample size increases, the statistical test may 
be futile (1938: 526-527). 


2 Significant is defined by the Grosset Webster Dictionary (1966, p. 526) as: 
1. Meaningful; expressive; full of implication. 2. Indicative; symptomatic; having concealed mean- 
ing. 3. Important; crucial. 
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In the course of an experiment during which data were collected on 
60,000 subjects, Bakan (1967: 6) ran several tests of significance, divid- 
ing the subjects into various groups, often according to arbitrary criteria, 
and found that the tests were always significant. A similar phenomenon 
was observed by Nunnally (1960) in calculating correlation coefficients 
on 700 subjects. As he points out, 

. . if the null hypothesis is not rejected, it usually is because the N is 
too small. If enough data is (sic) gathered, the hypothesis will generally be 
rejected. If rejection of the null hypothesis were the real intention in 


psychological experiments, there usually would be no need to gather data 
(p. 648). 


Unfortunately, such basic problems are seldom mentioned in intro- 
ductory inferential statistical or research methods textbooks. Two not- 
able exceptions are the Elementary Statistical Methods in Psychology 
and Education by Blommers and Lindquist (1960: 310) and the Research 
Methods in Social Relations by Selltiz, Jahoda, Deutsch and Cook 
(1959: 422), 

Illustrations with a t-Test 

The distinction that must be made between a significant and an im- 
portant difference will be illustrated with the help of various hypothetical 
situations. 


Suppose there are four sets of populations each having two subsets, 
with the following characteristics: 


(a) Set I U, = 99.5 and U, = 100.5 

SetII U;=99 andU:=101 

Set III Us=98 and Ue=102 

SetIV U,=96 andU; = 104 
(b) The scores in each subset are normally distributed. 
(c) The variance in each subset is equal to 225 

(Oro Oo = 1). 

If investigators interested in these populations draw samples of vari- 
ous sizes, say of 25, 100, 250, 500 and 2,000 subjects, and obtain in each 
case by luck, but without their knowledge, sample means equal to the 
corresponding populations means, they would obtain various ratios as 
shown in Table 1. 


The difference (eight) between U, and U, may be considered as more 
important than that (four) between U; and U,,, the latter more important 
than that (two) between U. and U,, and the latter more important than 
that (one) between U. and U,. 

When N is held constant, i.e., in each row, the value of the ¢ ratio 
is directly proportional to the difference in the population means. In 
other words for samples of the same size the greater the significance 
of the difference (or the lower the alpha level) the greater is the t ratio 
for the difference. Likewise, if the difference in the population means is 
held constant, the greater the number of subjects, the greater is the ¢ 
ratio. In this case, however, the relation is not directly proportional but 
only to the square root of N. 
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TABLE 1 


OBSERVED VALUE OF t WHEN SAMPLE MEANS EQUAL 
POPULATION MEANS UNDER VARIOUS SAMPLE SIZESft 


oo  aeaeqeonssq0—$—9—0— 0 NNN —sSs 


N in X,=U, =99.5 X,=U; =99 X,=U;=98 X.=U-,=96 
each 
sample X.,=U, =100.5 X,=U, =101 X,=U,,=102 X,,=U,=104 
25 24 47 .94 1.88 
100 47 94 1.88 eat le 
250 .74 1.49 2.98* 5.96* 
500 1.05 2.10 4/21* 8.43* 
2,000 BAA [MS Weal 8.43" 16.87* 


+Since the population variance is known, the critical value of t would be found 
in az table. 


*p < .05, assuming that the population variance is known by the investigators 
and that each of them is using two-tail tests. 


If the results are compared obliquely instead of horizontally or ver- 
tically, the conclusions are not as simple. For instance in cell (4, 1), the 
t ratio for the difference (t=1.05) is greater than that in cell (2, 2) 
(t=.94). However, the difference in the population mean may be considered 
more important in the latter case (two) than in the former (one). In both 
cases, however, the null hypothesis, that U;=U,, at an alpha level of .05 
would not be rejected and both investigators would have to suspend their 
judgement. 


If cell (5, 1) is compared to cell (1, 5), the situation becomes paradox- 
ical. In the former case an investigator would reject the null hypothesis, 
and thus find a significant difference although the difference in the 
population means is the lowest of the four sets of population, whereas in 
the latter case the investigator would not be able to reject the null 
hypothesis although the difference in the population means is much more 
important. Thus samples from populations with differences in means 
which could be considered as unimportant yielded “significant” dif- 
ferences whereas samples from populations having important differences 
in means would, under the circumstances noted here, be judged by an 
investigator as having non-significant statistical differences! The use of 
non parametric or free-distribution statistical tests in cell (1, 5) would 


not correct the situation since such tests are less powerful than para- 
metric tests. 


These contradictory results occur in rather ideal situations. In each 
case the sample mean would be equal to the population mean. Any in- 
vestigator would like such a situation but none expects to encounter it. 
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But if such contradictory results could occur in such an ideal type of situa- 
tion, one can imagine how much more contradictory results are likely to 
be in real situations where the sample means could rarely be equal to 
the population means. 


These hypothetical situations include other ideal conditions or as- 
sumptions that are seldom met in real investigations. For instance in the 
example the population variances were homogeneous and were assumed 
to be known by the investigators. In addition the scores were assumed 
to be normally distributed and it was also assumed that each investigator 
would select a two-tail test and use the same alpha level (Winer, 1962: 
13, feels that in some cases it would be more appropriate to use a 
.20 or .30 alpha level). Further, for each t test the number of subjects 
in each group was equal. Neither type I or type II errors were con- 
sidered nor was the problem of power taken into account (as would have 
been the case in the Neyman-Pearson approach). Finally, there was no 
analysis of the various kind of losses attributed to each type of error 
(as would be required in the Bayesian approach).3 


Among the factors that are usually under the control of an investigator 
only the number of subjects was varied in the previous hypothetical 
situations. When a certain percentage of the subjects selected at random 
fail to participate in the study, or when part of the data must be eliminated 
for one reason or another, the value of statistical inference is even more 
questionable. 


Finally, in the examples presented in Table 1, the larger the difference 
between U, and U, the more the difference was considered as important. 
Such an assumption is valid when similar variables or factors are taken 
into consideration. There are situations where a slight difference or a 
small ratio (say 10,000/9,999) between two parameters may have im- 
portant implications whereas in other situations a more substantial dif- 
ference or a higher ratio (say 102/98) have relatively unimportant im- 
plications. However, in testing automatically in each instance whether 
U,=U,, investigators are blindly attaching the same importance to the 
null hypothesis. Furthermore, since a slight difference between two para- 
meters may have important implications in a given situation, it follows 
that the statement made by Blommers and Lindquist (1960) that a 
“statistical significance is a necessary condition to the practical im- 
portance of any observed difference (p. 310)” is not necessarily valid 
for every situation. 


Test on Populations 
Some investigators even find it necessary to use inferential statistics 
when they have the total population. 
There is even the practice of using tests of significance in studies of total 
populations, in which the observations cannot by any stretch of the ima- 
gination be though of as having been randomly selected from any design- 
able population. Using the P value in this way, in which the statistical 
inference model is even hinted at, is completely indefensible; for the single 


3 Both the Neyman-Pearson and Bayesian approaches are discussed in Bakan (1967) and Clark (1963). 
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function of the statistical inference model is making inferences to popula- 
tions from samples (Bakan, 1967: 13-14). 


This problem may need further elaboration. Statistical tests such as t 


tests or analysis of variance, are based on the central limit theorem under 
which (M= fu i.e., the standard error of the mean of a random 
— 


lh 


sampling distribution (RSD) is equal to the population standard deviation 
divided by the square root of the size of the samples. For instance if 
the scores of a population are distributed normally as shown in Figure 
1, and samples of five subjects are drawn randomly from such populations, 
the long run average of the sample means would be distributed as 
shown in Figure 1,. If the number of subjects per sample was increased 
to 50, the distribution would be as shown in Figure 1 . As the number 
of subjects in each RSD increases, the shape of the curve becomes nar- 
rower and higher. 


re 2 > 


(a) (b) (c) (d) 
(a) (b) (c) (d) 
Total Random Random Distribution of 
Population Sampling Sampling Means of Total 
Distribution Distribution Population 
(N=5) (N=50) Measured Under 
Various 
Circumstances 


Fig. 1. Distributions under various situations. 


If an investigator is using a whole population, say 50 observations, he 


cannot claim any longer that ow= ___7 _. Some investigators argue 
V5) 


that they could test whether there is an error ettect unique to each in- 
dividual because of particular circumstances under which the measurement 
is made. If the measuring instrument is reliable, such error would be very 
small. Consequently oy would Be very close to zero, In which case any t 
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test would be infinitely large or significant. In other words, if the mea- 
suring instrument is reliable, the total population mean should not vary 


to any great extent from one administration to the other and, consequent- 
ly, the long run average of the means of the different administrations 
would be distributed as shown in Figure 1,. 


Correlation 


The ambiguity of significant difference as related to alpha level is 
even more obvious when applied to a correlation coefficient. No one, in 
general, would be impressed by a coefficient of .10 in a given population 
since the ratio of the variance of the predicted scores to that of the 
criterion scores is equal to .01, or, as most often questionably indicated 
in statistical texts, there would be 1 per cent of the variance accounted 
for. If the correlation coefficient of two variables measured on 400 sub- 
jects drawn at random was equal to .10, the null hypothesis that the cor- 
relation coefficient of the population from which the sample was drawn is 
equal to zero at an alpha level of .05, could be rejected (Walker & Lev, 
1958: 259). In other words, the correlation coefficient would be signifi- 
cant at an alpha level of 5%. But the rejection of the null hypothesis 
does not give any indication of the importance of the correlation co- 
efficient in the population. It merely indicates that it is most likely dif- 
ferent than zero. It may be only .01, for instance, in which case the ratio 
of the variance of the predicted scores to that of the criterion scores 
would be equal to only .0001. 

Alternatively, a low correlation coefficient may be due to a curvilinear 
relationship. How may investigators verify if the linear assumptions is 
tenable by means of a scatter diagram or other method when they cal- 
culate a correlation coefficient? It would seem more important to verify 
this assumption rather than finding out if the correlation coefficient is 
significant. 


Test for Trends 
Similar misleading conclusions can be made in the interpretation of 
tests for trends. For instance, Kirk (1968: 116-123) refers to a hypothe- 
tical situation where an investigator is interested in the effects of sleep 
deprivation on hand steadiness. The findings are shown in Figure 2. 


High 


Hand steadiness 


3 
fc) 
— 


Low High 
Level of sleep deprivation 
Fig. 2. Linear and quadratic test for trends (After Kirk, 1968: 116-123). 
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Both the test for the linear and the quadratic trends were significant. 
There does not seem to be any doubt, from inspection of Figure 2, that 
the linear trend is much more important than the quadratic trend. As Kirk 
points out, “of the 194.5 units of variation due to differences in sleep 
deprivation, the linear components accounts for 184.9, or 95.1 per cent of 
the variation (p. 122).” Attributing the same importance to these two trends 
because they are both significant may be quite misleading. 


Effective Contributions or Goal Distortions 

In the light of the remarks of the preceding pages, it may be appropriate 
to ask if the use of the Fisher approach in statistical analysis contributes 
to the improvement of any research design. It is possible that it does in 
certain cases. However, is the improvement such that it compensates for 
the efforts that investigators, especially graduate students, must invest in 
the understanding (or perhaps more precisely, some form of understand- 
ing) of statistical techniques? 

According to the economic law of diminishing return, there is a point 
at which an increase in one factor of production, will yield a decline 
rather than an increase in marginal productivity, unless the quantities of 
the other factors are altered (Samuelson, 1958: 22-24). It may be ap- 
propriate to apply this law in educational research making sure that there 
is a proper balance between statistical techniques and other research 
techniques. 

It is also possible that the attention that is given to statistical tech- 
niques obscures other research design problems. Speaking of the law of 
instrument Kaplan (1964) points out that: 

It comes as no particular surprise to discover that a scientist formulates 

problems in a way which requires for their solution just those techniques 


in which he himself is especially skilled . . . What is objectionable is not 
that some techniques are pushed to the utmost, but that others, in con- 
sequence, are denied the name of science . . . Electronic computers, game- 


theoretic models, and statistical formulas are but instruments after all; 
it is not they that produce scientific results but the investigator who uses 


them scientifically. Paul Meehl . . . pointedly asks (in a paper with the 
question as title), when shall we use our heads instead of the formula 
(pp. 28-29)? 


The danger is that instead of cultivating invention, educational in- 
stitutions cultivate procedures (Kaplan, 1964: 15-16). It is even possible 
that procedures, especially statistical techniques, are not even cultivated 
at all. Some graduate students may merely apply statistical techniques in 
a cookbook approach with the consequence that their training in research 
may be very minimal or even detrimental. This phenomena may be com- 
pared to that of goal distortion and displacement usually present in 
bureaucratic organizations (Bacilious, 1968). 


It is encouraging, however, to note that the Review of Educational Re- 
search, in its last issue (1969) on Methodology in Educational Research, 
has devoted only one chapter out of ten to statistical techniques as com- 


pared to the previous issue (1966) reviewing the same area in which case 
five chapters out of eight were devoted to statistical techniques. This may 


be an indication that researchable problems will less and less be made 
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synonymous with problems that could be analysed through statistical 
inferential procedures. 


Possihle Solutions 


Statistical techniques should not be denied the status of scientific 
techniques either. This would be passing from one extreme to the other. 
There is a proverb in French that says: “La vertu reside dans le juste 
milieu.” If the Fisherian approach includes many shortcomings, this does 
not mean that statistical techniques may never have their place in a re- 
search design. The Neyman-Pearson and Bayesian approaches, which 
have been used only to a very limited extent in behavioral sciences, may 
bring improvement in the formulation of research problems (Bakan 
1967: 25-28; Clark, 1963: 458-464). However, both approaches, especially 
the Bayesian school, are much more complicated to use. According to 
Meyer (1969): 

The teaching of Bayesian statistics is a good deal more difficult than 
teaching traditional methods. The students need to know more probability 
theory and more distribution theory. Since Bayesian theory is more re- 
sistant to a cookbook approach, a deeper understanding of underlying 
processes is necessary. They may be an advantage since it may reduce the 
common misuse of genuinely difficult concepts by those who have been 
taught to summarize data by reading the .05 value of t (p. 728). 


The difficulties involved in the use of Bayesian statistics and those of 
other research techniques may be an indication that it will become more 
and more important to think in terms of teams of researchers where the 
talents of each individual could be used to fullest potential. If it remains 
essential that all graduate students receive training in research before 
leaving the university, it may not be essential that they acquire this 
training through the undertaking of individual theses or dissertations. 
This training could be acquired through their participation, during a 
certain period, in short range or long range research projects, undertaken 
by groups of staff members. 

It may take a long time before university authorities accept such a 
setting. It is hoped, however, that the limitations of statistical techniques 
will be recognized by those concerned and that students will not be pre- 
vented from presenting and analyzing their quantitative data with the 
help of descriptive statistics, graphic presentation, statistical tables or 
any other means that may fulfill the purpose of their investigation. A 
book like that of Zeisel (1968) would be of great help in this regard. 


Concluding Remarks 

Some of the concluding remarks of Bakan’s (1967) chapter on the test 
of significance may well summarize the main thoughts developed in 
this paper. 

When we reach a point where our statistical procedures are substitutes 

instead of aids to thought, and we are led to absurdities, then we must 

return to common sense. . . . We must overcome the myth that if our 

treatment of our subject matter is mathematical it is therefore precise and 

valid... . Mathematics can serve to obscure as well as reveal (p. 28-29). 

(Italics added). 
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Appropriateness of Problems for 
Discussion with Counsellors 


The purpose of the present investigation was to examine the role of the 
high school counsellor as perceived by counsellors, principals, and counsellor 
educators. An attempt was made to discover what consensus exists among 
these three groups regarding the appropriateness of various topics for 
discussion with a counsellor in an Alberta high school. Results indicated 
that counsellor educators perceive all problem areas as equally appropri- 
ate for discussion with counsellors. Principals and counsellor educators 
were on agreement with counsellor educators on one factor (EV) but 
principals felt that personal problems (ASO, LRM) were less appropriate 
for discussion. As expected, counsellors themselves were between the two 
extreme positions in regard to personal problems. They ranked personal 
problems as more appropriate than did principals but less appropriate 
than did counsellor educators. The results were discussed in terms of a 
“conflict” hypothesis. 


If the school counsellor is to become a professional with an important 
part to play in the total educational context, his role must be clearly 
delineated. All too often the function of the counsellor has not been 
made clear. It has sometimes been assumed that he deals to a large 
extent with the personal-social, educational, and vocational con- 
cerns of individual students; but many times the counsellor has 
simply performed those tasks assigned him by the administration. 
Part of the problem lies in the fact that counsellors themselves, be- 
cause of no consistent educational background, are not certain about 
the functions they should be performing in the school setting. A role 
conflict emerges when the counsellor wants to function in ways which 
are incongruent with the principal’s expectations. 

Many research studies have been carried out investigating the per- 
ceived role of the school counsellor (Grant, 1954a; Warman, 1960; 
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Sweeney, 1966). The results of these studies indicate considerable dif- 
ference of opinion about what a counsellor should be doing. Opinions 
seem to differ, particularly on the appropriateness of different topics 
to be discussed in interviews with students. Educators and researchers, 
generally, show disagreement in regard to the appropriateness of the 
personal social problem area as a topic for counselling interviews 
with students, whereas educational and vocational planning appears 
to be generally accepted as the counsellor’s function. Grant (1954a, 
b) found that 50 to 80% of his sample of students, teachers, and ad- 
ministrators in the schools of New York City agreed that counsellors 
should do educational and vocational counselling. Only 4% of the stu- 
dents indicated that they would go to a counsellor with personal- 
emotional problems. It appears that the problem of agreement on 
perceived counsellor role has not been resolved in the American schools 
where counselling programs have existed for some time. The main 
points of disagreement seem to be: (a) the counsellors role in the 
personal-social realm, (b) the assignment of duties to the counsellor, 
and (c) his relationship with the administration. 


A review of the research in Alberta (Zingle & Winship, 1967; 
Altmann, 1969; West & Zingle, 1969; Ford & Koziey, 1969) indicates 
no agreement on the perceived role of the counsellor in Alberta 
schools. Thus it would seem that the situation in Alberta is similar 
to the American scene where there is, as yet, no careful delineation 
of counsellor role. The Ford and Koziey (1969) study focused on the 
student’s and counsellor’s perceptions of the counsellors role and 
found marked difference between them. The present research attempted 
to extend the examination of the perceived role of the counsellor by 
involving a significant number of high schools in the province. More 
specifically, it was the purpose of this study to determine whether 
there were significant differences among principals, counsellors, and 
counsellor educators in their judgment of the appropriateness of dif- 


ferent topics for discussion with students in a counselling situation in 
Alberta. 


Method 
The Instrument 


Warman’s (1960) Counselling Appropriateness Check-List (WCAC) 
was the instrument employed in this study. All three groups in the 
study (counsellors, principals, counsellor educators) were asked to 
indicate on a 5-point scale the extent to which they considered each 
of the 66 items describing a problem appropriate for a discussion with 
a counsellor. The three factors found in the WCAC were College 
Routine, Vocational Choice, and Adjustment to Self and Others. 

In May of 1969 the WCAC was sent to all Alberta high school 
counsellors, principals and counsellor educators. Two reminder letters 
were sent at two-week intervals and final returns were complete by 
the end of the first week in July. Of the 298 counsellors contacted, 
188 responded to the WCAC giving a 68% return. One hundred and 
eighteen principals (all in schools with counsellors) responded to the 
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WCAC, representing a 69% return. Of the 20 university professors 
contacted, 14 returned their check-lists, giving a 70% return from this 
group. 

A factor analysis using varimax rotation was performed on the 
scores obtained on the WCAC. This was followed by an analysis of 
variance to compare the scores of the three groups on each of the 
three factors derived. To make between-group comparisons, ¢ tests 
were then applied. 

An alpha level of .05 was chosen as the significance level accept- 
able throughout the study. 


Results 

Factor analysis, using Varimax rotation, of the WCAC produced the 
following three factors: 

Factor 1, ASO (Adjustment to Self and Others), includes items 
such as wanting to be more popular, lacking in self-confidence, feel- 
ing timid, etc. 

Factor 2, EV (Educational-Vocational), includes items concerning 
school routine; namely, ineffective use of study time, proper curriculum 
choice, choosing an occupation, etc. 

Factor 3, LRM (Love, Religion, Morality), includes: being disap- 
pointed in a love affair, having to wait too long to be married, having 
conflicts about religion, etc. 

Two items did not load on any of the three factors and were dis- 
carded leaving a total of 64 items. 

The purpose of this research was to determine whether differences 
exist among counsellors, principals, and counsellor educators as to 
the rated appropriateness of various topics for discussion in a coun- 
selling situation in an Alberta high school. The problem areas were 
identified as ASO, EV, and LRM. Significant differences were found 
on the ASO factor (F=44.49; df=2,281; p< .001) and the LRM factor 
(F=22.58; df=2,281; p< .001). No significant differences were found for 
the EV factor. 

Figure 1 gives a graphic representation of the general differences 
between groups on all three factors. This figure shows the average 
item score made by respondents from each group on the items in each 
problem area. 

It can be seen that counsellors and principals considered the EV 
factor the most suitable of the three areas of problems for discussion 
with high school students, while counsellor educators placed ASO 
slightly higher in their hierarchy. Principals fell behind the other two 
groups in the placing of ASO and LRM items. As regards the LRM 
factor, counsellor educators considered these items much more ap- 
propriate than did the principals and counsellors. Principals found 
LRM items the least appropriate for discussion. Counsellors rated them 
higher and counsellor educators considered them still more appropri- 
ate than counsellors did. 
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Fig. 1. Mean item scores for three groups on each of three factors. (EV=Edu- 
cational-Vocational problems; ASO=Adjustment to Self and Others; LRM=Love, Re- 
ligion and Morality problems). 


In summary, counsellors and principals differed to a greater extent 
than did counsellor educators in their view of the appropriateness of 
each factor and placed the items in this order: EV, ASO, LRM. 
Counsellor educators ranked ASO, EV, and LRM in order of appropri- 
ateness with no significant differences between factors. 


Discussion 


The findings revealed a significant difference among counsellors, 
counsellor educators, and principals in their judgment of the appropri- 
ateness of two different areas of discussion with students in a coun- 
selling situation. A consensus appeared in only one area among the 
three groups regarding the function of a counsellor in Alberta high 
schools. They all agreed that it is appropriate for counsellors to deal 
with the Educational-Vocational (EV) problems of high school stu- 
dents, but agreed less on the validity of discussing problems about 
Adjustment to Self and Others (ASO) and Love, Religion and Mora- 
lity (LRM). Since counsellor educators viewed the counsellor’s role as 
including ASO and LRM problems in addition to EV concerns, they 
may very well be attempting to prepare counsellors for a role which 
is not possible for them to fulfill in many schools. Hart and Prince 
(1970) concluded from their study of principals and counsellors in the 
Utah secondary schools that school counsellors were taught many role 
philosophies and behaviors that are in conflict with the expectations 
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of principals. Perhaps we should be asking if the counsellor education 
programs are too idealistic since the counsellors after training are 
finding different job demands in the schools. It might be better still, 
however, to ask it there are not new ways to effectively acquaint 
principals with the importance of this ideal counsellor role so that 
they may better understand it and adopt appropriate expectations. 


It appears that all groups are quite willing to allow counsellors to 
deal with educational and vocational guidance, but there are many 
reservations regarding the discussion of specific problems of LRM, 
or even of ASO. In an additional note attached to their returned 
questionnaires, some counsellors and counsellor educators stated that 
they would like to refer students who bring up such topics to the specia- 
lists hand, such as chaplains and marriage counsellors who could deal 
more adequately with these problems. Others stated that they want 
the student to determine the problem: any topic he brings up in a 
counselling interview is an appropriate one for discussion, or at least 
for “listening” on the counsellor’s part. These counsellors would ap- 
pear to be in accordance with the view that the counsellor’s primary 
responsibility is always for the student and his needs. 


An interesting difference was noted in the present study regarding 
the three factors resulting from the factor analysis of the Warman 
Check-List. Warman, as well as Ogston, Altmann, and Conklin (1968), 
found Vocational Choice (VC), College Routine (CR), and ASO to be 
the three factors into which the items fell. This present research 
found that the educational and vocational area was covered by one 
factor, EV, while the personal area was subdivided into a non-threaten- 
ing personal and interpersonal relationship factor, ASO, and a factor 
relating to problems of love, sex, religion, and morality, LRM. It might 
be interesting to speculate on reasons for this difference in factors and 
conduct research in an effort to clarify the factor structure of the 
Warman scale. 
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Retroactive Interference in A 
Meaningful Learning Task 


Retroactive interference has been observed in a number of verbal learning 
tasks, but not in classroom learning situations requiring non-verbatim 
recall of meaningful structured material. The present experiment tested the 
prediction that retroactive interference would occur when students had not 
only to read but also to recall similar materials interpolated between pre- 
sentation and reproduction of a meaningful prose passage. The 96 young 
adult female subjects formed 4 experimental groups in a 2 x 2 design. 
The independent variables were similarity to the original passage of the 
interpolated materials (similar-dissimilar) and the recall instructions for 
them (recall-no recall). The effects of neither variable were significant, 
and it was concluded that no evidence exists for retroactive interference in 
learning tasks requiring substantive reproduction of meaning verbal sub- 
Ject-matter. 


Introduction 

There have been numerous demonstrations of retroactive interfer- 
ence in verbal learning experiments, and the authors of a number of 
textbooks on Educational Psychology (e.g. Andreas, 1968: 81; Bigge 
& Hunt, 1968: 465; Blair, Jones & Simpson, 1968: 233-234; Edwards 
and Scannell, 1968: 343; Macdonald 1965: 239; Mouly, 1968: 365) 
have referred to this phenomenon, with explicit or implicit suggestions 
that retroactive interference may be an influential variables in classroom 
learning. Macdonald (1965), for instance, states that: “In general, the 
teacher should expect students to have difficulty retaining highly similar 
materials which are learned in close proximity to each other.” 

Ausubel, Stager & Gaite (1968), however, while admitting the validity 
of retroactive interference for verbal learning in studies using meaningless 
and unconnected materials, express doubt as to whether it occurs when 


49 


M. Howe & P. Cavicchio 


materials are meaningful learned, and studies by Ausubel and his as- 
sociate (Ausubel, Robbins & Blake, 1957; Ausubel, Stager & Gaite, 1968) 
and others (e.g., Hall, 1955; Mehler & Miller, 1964) show that when mean- 
ingful connected verbal passages have to be recalled no retroactive inter- 
ference occurs, except in situations requiring verbatim recall. Thus there 
appears to be no firm evidence of retroactive interference in the sort 
of class situation whereby meaningful learning takes place. 


Yet it is noticeable that in all the above studies which failed to show 
evidence of retroactive interference, the interpolated similar materials 
were provided by the experimenter rather than by the subjects, and the 
latter did not at any stage have to produce or reproduce these interpo- 
lated items. In many classroom learning situations the learner himself 
provides similar interpolated materials, and it is conceivable that there 
may be retroactive interference when a subject provides or recalls items 
that are similar to the original verbal passage. Results obtained by Kay 
(1955) and by Howe (1970b) indicate this to be a reasonable suggestion. 
In these studies students were required to make repeated attempts to re- 
call meaningful prose material, and there were repeated presentations of 
the correct version. The results of both experiments indicate that subjects’ 
early recall attempts very strongly influence their later reproductions. 
Although a presentation of the correct version occurred between each at- 
tempt at recall, the content of each attempt was extremely similar to 
the previous one, the errors as well as the correct material being re- 
peated, and a number of the subjects in Howe’s (19706) study spontane- 
ously remarked upon their surprise and frustration at the limited extent 
to which they found themselves able to profit from the repeated pre- 
sentations of the correct material, to modify and improve the accuracy 
of the remembered version. It appears that recall drew upon relatively 
stable versions of the material as processed and coded by each individual 
subject, and that those parts of the processed versions that were incorrect 
interfered with retention of the correct information. Additional evidence 
for the effects of learner-produced reproductions upon subsequent retention 
of prose material is available from studies of notetaking (Howe, 1970a; 
in press). 

These results are consistent with the suggestion that retroactive inter- 
ference may occur in school situations where interpolated material is 
both similar to the meaningful verbal passage being learned, and is pro- 
duced by the subject himself. The present experiment was designed to 
examine this possibility. Briefly, subjects were required to read prose 
material, then they read similar or dissimilar passages, and next either 
recalled the interpolated material or read other (entirely different) pas- 
sages, and finally attempted recall of the original. It was predicted that, 
in line with the results obtained by Ausubel, Robbins & Blake (1957) 
and Ausubel, Stager & Gaite (1968), when subjects had to read but not 
reproduce similar interpolated material, recall of the original passage 
would not be inferior to recall in the condition whereby the interpolated 
material was dissimilar. On the other hand, when subjects had not only 
to read but also to reproduce the interpolated passage, interference re- 
lated to similarity was predicted. This would lead to recall of the original 
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prose passage being less accurate following reproduction of similar interpo- 
lated material than in the condition where the reproduced interpolated 
material was dissimilar to the original version. 


Method 
Subjects 


The subjects were 96 young women (Mean age 19 years) who were 
enrolled in a one-year course at Tufts University Dental School, studying 
to be dental assistants. The subjects were tested in 4 approximately equal 
batches, and within each an equal number were assigned to each of the 
4 experimental conditions. 


Experimental Design and Materials 


A basic 2 x 2 design was used in which the independent variables were 
similarity (similar, dissimilar) of the interpolated material to the original 
prose passage being learned, and activity succeeding presentation of the 
interpolated passage (recall passage, read different material). The original 
passage was a set of instructions of lifesaving by the Chest Pressure 
Arm Lift (Silvester) Method, and was approximately 200 words in length. 
The similar interpolated passage was of equal length, style and structure, 
and consisted of lifesaving instructions using the Back Pressure-Arm Lift 
(Holger-Nielsen) Method. The dissimilar interpolated passage contained 
instructions for making a vanilla souffle, and was equal in length to the 
other materials. The subjects who were not required to recall the inter- 
polated passage spent the recall period reading a 2500-word extract 
from a story by Kafka (“The Metamorphosis’), which was highly dissimilar 
to any of the other materials used. 


Procedure 

After listening to instructions subjects were handed sheets containing 
the original passage, and were alloted 5 minutes in which to study it. 
Then they returned the sheets and were provided with a second passage 
which they were also told to read. For half of the subjects this passage 
was similar to the original, and for the others it was dissimilar. These 
materials were in turn collected and half of the subjects in each of the 
similar and dissimilar groups received instructions to attempt written 
recall of the second (interpolated) passage, while the others received the 
additional (dissimilar) reading matter. The duration of this period was 
10 minutes. Finally, all four experimental groups were handed blank 
sheets of paper, and they were told to write as much of the content 
of the first passage as they could remember. To prompt recall the title 
of the passage (“The Chest Pressure Arm Lift (Silvester) Method”) was 
provided. Ten minutes were allowed for written recall. 


Scoring 

For scoring recall the passage was divided into 20 successive segments 
containing non-trivial meaningful content, and guidelines were provided 
specifying the minimum data that were judged as being acceptable in con- 
veying the essential elements of meaning in the segment. This method of 
scoring meaningful recall was partly based upon procedures devised by 
Cofer (1941) and had been used by the senior author in a recent study 
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(Howe, 19705), with materials similar in length and structure. Since the 
product moment correlation for scores between difference judges was 
+.89, it was considered that the method of scoring meaningful recall 
was sufficiently reliable for the present experiment. 


Results 


The mean numbers of meaningful items correctly recalled (out of 20) 
were as follows: Similar Interpolated Material, Recall Required, 12.75 
items; Similar Interpolated Material, Recall Not Required, 12.25 items; 
Dissimilar Interpolated Material, Recall Required, 13.62 items; Dissimilar 
Interpolated Material, Recall Not Required, 13.41 items. Neither of the 
independent variables had a significant effect. For the Similar-Dissimilar 
(interpolated material) variable F = 1.78, df = 1/92, and for Recall-Non 
Recall (of interpolated material) F <1, df = 1/92. There was no significant 
interaction between the effects of the two variables, F <1, df = 1/92. 


Discussion 


The present results supports those obtained by Ausubel, Robbins & 
Blake (1957) and Ausubel, Stager & Gaite (1968) in finding no evidence 
that similarity of interpolated material which subjects were required to 
read but not reproduce affects meaningful recall of substantive prose 
material. In contrast with the prediction, even when similar interpolated 
materials did have to be reproduced, there was no measurable retro- 
active interference. It would seem that the findings of Ausubel and his 
colleagues can be extended to situations that require active recall of 
interpolated similar items. There is no evidence that retroactive inter- 
ference occurs in situations requiring retention and meaningful (rather 
than verbatim) recall of structured prose material. 


It is difficult to explain the apparent discrepancy between the present 
results and those obtained in the earlier studies by Howe (19706) and 
Kay (1955). In both of these it appeared that factors related to the pro- 
cessing of materials underlying early incorrect attempts at recall of a 
prose passage interfered with subsequent retention of the correct version. 
The most likely explanation is that such interference occurs solely in re- 
lation to specific materials that a learner is attempting to retain. 


There are certain school learning situations where retention is al- 
most inevitably of a rote or unstructured nature. This is the case in some 
facets of foreign language acquisition, and in such instances it is quite 
conceivable that retroactive interference phenomena can exert an influence 
upon performance at learning tasks. However, the present findings provide 
no indication that retroactive interference occurs to any noticeable extent 
in the more highly structured and meaningful situations encountered in 
classroom learning. One should add that in the research literature on this 
area there is an implicit assumption that learning is either meaningful or 
rote, structured or unstructured. In fact these are continuous variables, 
and the exact values of them at which retroactive and proactive inter- 
ference begin to occur remain to be found. 
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Instructional Applications of The Computer 
—An Experimental Course! 


In the spring of 1969 an experimental course entitled “Instructional Ap- 
plications of the Computer” was offered for the first time to education 
students at The University of Alberta. In the accompanying paper, the 
course is described in terms of objectives and activities. A description of 
the students who participated in the course is also given and the results 
of their evaluation of the course are presented. A revision of the course 
was offered in the first term of 1970 and a preliminary evaluation of the 
revision is given. 


Introduction 
Of the few courses about computer-assisted instruction (CAI) that have 
been taught in Canada or the United States, most were for graduate 
students. Each course was directed toward some useful educational ob- 
jective but none represented a goal we think is also important, that of 
ultimately equipping all education students with an understanding of 
CAI and its relationship to teaching. 


In the 1969 spring term, an experimental course for undergraduates 
about computer-assisted instruction (CAI) was undertaken at The Uni- 
versity of Alberta. The course, which was called “Instructional Applications 
of the Computer’, was based in part on the class notes developed during 
the previous term by one of the authors (B. L. Hicks) while on sab- 
batical leave from the University of Illinois. Because the course was a 
pioneering venture and because the authors and the students analysed 
the value of the course rather carefully, it is felt that this account may 
be useful to others who are thinking of starting a course about CAI 
for undergraduates. 

1 We should like to acknowledge the help of several who worked with us and with the students on 
the course: T. Kieren, A. D. Fisher, R. H. Hughes and J. E. Couture. Miss Diana Gibbons assisted 


in the analysis of the course. The Division of Educational Research Services and the Carnegie 
Corporation supported the work of B. L. Hicks on the course during the spring term. 
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General Description of the Course 


The course was chiefly concerned with computer-assisted instruction 
and its use by the teacher in conjunction with other ongoing teaching- 
learning activities. 


Proper use of CAI in the schools will directly benefit instructional 
processes in education. But there will also be indirect benefits of the 
use of computers in the schools by students and teachers. Schools of 
the future will apply computers not only for purposes of instruction but 
also in many other ways, for example, in scheduling, in maintaining 
school records, and in counselling. Like other citizens, students and 
teachers live in a society that is now and will, even more in the future, 
be affected by the computer and its technology. As students see the 
usefulness (and the limitations!) of computers in instruction and in other 
school activities, they will learn much about the role of the computer and 
its technology in society. 


Computer-assisted instruction, because it is designed to serve the com- 
plex processes of instruction and learning, is itself a complex subject 
whose rational development has only been started. A serious treatment 
of the subject therefore makes unusual demands both of the students 
and of the professors in a CAI course. It would be a mistake to gloss 
over this complexity even in the present introductory course. But an at- 
tempt was made to avoid the fate of so many specialists who, in trying 
to make a contribution to education, succeed only in elaborating their own 
specialty in a slightly new context. No presentation of the specialized 
findings of all those who have worked in computer-assisted instruction 
was made. Instead, many of the practical and deep questions about com- 
puter-assisted instruction and its relation to other means of instruction 
were investigated. Many of the questions were left unanswered, but in the 
process of asking and trying to answer them a common language was 
developed by professors and students, suitable for a serious discussion 
of computer-assisted instruction. 


The course was meant for those who are teachers or are soon to be- 
come teachers in elementary and secondary schools. It was designed to 
explore enough about the nature of this remarkable new educational tool, 
computer-assisted instruction, so that teachers will be able to help de- 
velop and manage it in the schools of the future. The course was not 
designed to train computer programmers, though the authors are con- 
vinced that many of the questions dealt with in the course should be 
thought about seriously by anyone, programmer, teacher, curriculum 
specialist, parent, or educational administrator, who will in the future 
have a direct hand in managing or designing the use of CAI in the schools. 
It was expected that the course would persuade some teachers to go into 
programming and some programmers to appreciate educational ap- 


plications of computers, two desirable outcomes, though not the primary 
goal of the course. 


If there was one inclusive purpose behind this course, it was to en- 
hance the creative and critical faculties of the future teachers in using 
and managing a new educational tool. Therefore the nature of CAI systems 
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and how they are created were reviewed first. An effort was made not 
to adhere to any one educational theory nor to any one philosophy of 
computer use in education. A variety of CAI materials were then evalu- 
ated, in student-faculty teams. Indeed, student-faculty involvement was 
sought throughout the course. Once they grasped the essential nature of 
CAI and its potential uses in education, the students could make the de- 
cisions about just what CAI materials and programs would be evaluated 
and how the task could be approached by the student-faculty teams. 
The students therefore found in this course both freedom and responsibi- 
lity as they endeavored, jointly with members of the faculty, to enlarge 
their creative and critical faculties. It is hoped that these future teachers 
will remember the value of student involvement when they come to deal 
with students in the primary and secondary schools. 


Class Composition 


More than thirty students applied to take the course. Most of them 
had just finished bachelor degrees in arts or science and were in the 
first year of a teacher preparation program. Sixteen were chosen to form 
a class which would have a varied background. The class was composed 
of: 

(a) students representing seven different areas of specialization (mathe- 
matics, physical, biological and social science, English, business 
education, and physical education), 

(b) students in both elementary and secondary education, and 

(c) students with experience in computer science and those without 
this experience. 

In this first experiment with a course about CAI for undergraduate 
education students it was decided to work with one class of moderate 
size so that instruction could be informal and there could be close 
student-faculty contact in the teams working outside the class. 


Course Activities 


During most of the class sessions three out of the four faculty ad- 
visors were present. 

The term was divided into three sections. The first section of four 
weeks introduced the students to the essential concepts of CAI, through 
readings, class discussion and experience on two CAI systems in the 
CAI laboratory of the Division of Educational Research Services, The 
University of Alberta. During the second section of seven weeks, which 
coincidently included the three weeks of student teaching, the students 
met in small teams with their faculty advisers to develop joint reports 
on a major problem of interest. In the third section of two weeks the 
reports were finished and discussed thoroughly in class. 

The topics treated in class included the following: 

1. Sharpening perceptions of teacher behavior, 

2. Comparison of instruction in the classroom and on CAI, 

3. The Community Computer-Based Educational System—a complete 

CAI System, 
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4. Some elements of instructional programming, and 
5. Critical review of articles and reports. 


Reading in the CAI literature were available to the students in a 
special file and were supplemented by a number of handouts in class that 
were related to the above topics, to the long term assignments, or to the 
laboratory exercises. The readings and four of the handouts are listed at 
the end of the present paper. 

The principal assignments were: 

1. Preparation of a paper of not more than 2000 words describing 

either: 
(a) an ideal teaching environment, or 
(a,) teaching activities considered to be uniquely human 
and (b) resources needed for an effective teaching environment, 
(c) probable CAI-induced changes in school plant, personnel and 
administration, and 
(d) questions about CAI that should be considered in class during 
the term. 
The paper was submitted in the fourth week of the term. 

2. Participation in one of the team projects leading to a written report 
that was presented and discussed in class. The seven projects were: 

(a) Analysis of Student Response—Recognition of Correct Answers. 

(b) Analysis of Student Response—Implications for Pedagogy and 
Learning, ; 

(c) Analysis and Evaluation of the Demonstration Program developed 
by the Division of Educational Research Services, University of 
Alberta, for the IBM 1500. 

(d) Implementation of a Large CAI System in the Province of Alberta, 

(e) CAI Applications in Social Science (Meteorology), 

(f) CAI Application in Social Science (Economics), and 

(g) Native Education in Northern Alberta. 


In the laboratory phase of the course the students made use of two 
CAI systems: (a) the 2741 typewriter terminals connected to the IBM 
360/67 computer; and (b) the IBM 1500 System. Each student used both 
systems in studying DRILL 1, a CAI program illustrating many aspects 
of instructional programming. Each student interacted with the demon- 
stration program developed for the 1500. One group of students analyzed 
the package much more thoroughly as part of their term project. 


Comments and Conclusions 


Several opportunities for student feedback were provided both for- 
mally and informally. From that source and from the observations made 
by the staff during the course a number of strengths and weaknesses were 
noted. The informal intensive student-faculty interaction in and out of class 
was seen as beneficial. The staff student ratio of four to sixteen, would 
be unrealistic for a regular course. However, the students may have been 
reacting as much to staff accessibility as to the number of staff involved. 
A second strength noted by the students was the opportunity for making 
frank comments on the course. Clearly, all suggestions could not bring 
about changes in the course direction, but an attempt was made to use 


58 


Experimental Course 


the feedback to modify the course. A third general strength was the 
class project which allowed the students to be creative, to be critical and 
to take responsibility for a segment of the course. 


A second set of strengths derived from the topics and activities. The 
students were stimulated to take an informed interest in the promise 
and problems of CAI. They realized that the most important questions in 
evaluation of CAI are educational questions, not those of hardware and 
software. By studing and assaying the potential of CAI, the students 
became more precise in their conception of the problems of education in 
general. A particularly good procedure for developing this precision was 
the simulation of a computer and of a teacher by one of the staff, when 
each performs only the instructions defined specifically by the class. This 
had the additional outcome of generating a good deal of respect for the 
complexity of the teacher as an information processing system. 


A final activity which was deemed useful was the opportunity to 
observe the performance of children working at CAI terminals. Under 
such circumstances it was apparently easier to put oneself in the children’s 
position from certain strengths and weaknesses of CAI in general and the 
demonstration program in particular become obvious, when they would 
not have been otherwise. 


Not all of the feedback was laudatory; several weaknesses were noted. 
The most serious early weakness was that the goals of the course were 
not clearly spelled out to the students. Thus some of the students were 
unsure of what was expected of them. This problem was compounded by 
inadequate checking and discussion of the reading done by the students. 
As a consequence, the instructors tended to assume a greater knowledge 
on the part of the students than they actually had. Another weakness 
was in the sequencing of hands-on experience with CAI systems. Whereas 
it should have been one of the early activities, it was delayed until mid- 
way through the course. The course was designed for use in institutions 
where CAI systems are not available. However, in situations where sys- 
tems exist, delaying experience with the system becomes a source of 
frustration to the students. 

A different weakness resulted from the selection of students to affect 
a balance between students with computer experience and those without. 
It was hoped that the two groups would be supportive of each other. 
Instead their interests tended to split the class into two groups. The stu- 
dents with computer experience tended to be oriented toward hardware 
and programming, whereas the other students were more concerned with 
the social issues related to CAI implementation. This problem could be 
overcome by forming project groups along lines which place individuals 
with complementary skills in the same group. In the trial course, pro- 
ject groups were formed on a volunteer basis. 

A final weakness was that there was not nearly enough time for the 
projects, and in fact for the whole course. This was due to the loss 
of three weeks for practice teaching. A full semester is necessary to 
achieve the kinds of understandings anticipated by the instructors. 

During the first semester of 1970 the CAI course was tried again 
with enrollments coming primarily from students in the third and fourth 
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years of the Faculty’s education program. One problem previously voiced 
by the students, the fact that early experience in the use of the CAI 
system was not provided, was corrected. In addition, all students were 
asked to learn how to program the IBM 1500 computer using Course- 
writer II by following a set of laboratory exercises. Some opportunity was 
made available for students to view other instructional programs authored 
by more experienced teachers and authors. As background to the construc- 
tion of CAI lessons a review of how to define educational objectives and 
learning theory was attempted. Once the students had completed a major 
portion of the laboratory problems, a cursory picture of how the com- 
puter system operates was given. 


For about one-quarter of the students one semester was insufficient 
time to adequately cover all the work assigned, with the result that 
some of the more important readings were not covered. The laboratory 
problems used to introduce the student to Coursewriter I] were considered 
to be too sterile, i.e., each problem could not be used as a basis by ac- 
cumulation to produce a small course by the time the last problem was 
completed. Some students did however go far beyond the material covered 
in class and actually constructed sophisticated course sequences. Part 
of this was probably due to having placed some of the course material 
on the computer itself for teaching to the students at their own speed 
and time. The chance to view the work of other authors was well re- 
ceived since it provided a concrete example of the computer’s potential 
as well as how others had organized their course content. The cursory 
introduction to what the computer must do ‘behind the scenes’ was also 
well received and gave the students a better appreciation for some of the 
technical problems associated with a time-sharing CAI system. 
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Handouts 


The handouts included: 

(a) Will the Computer Kill Education? (B. L. Hicks). To be published in The 
Educational Forum. 

(b) Rationale for Research on Experimental CAI Courses for Teachers (B. L. 
Hicks). 

(c) Definitions in CAI. 

(d) A Short Guide to Critical Evaluation of CAI Literature. 
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BOOK REVIEWS 


EDUCATIONAL IMPLICATIONS OF PIAGET’S THEORY. 
By Irene J. Athey and Duane O. Rubadeau (Editors). Waltham, Mass.: 
Ginn-Blaisdell, 1970. 


Although Jean Piaget was born in 1896, and although he has long 
since completed most of the work which is now receiving so much at- 
tention on this continent, he has relatively suddenly become a hot pro- 
spect among publishers. Indeed, the impact of Piagetian theory on child 
psychology, on research in development, and on educational practice is 
quite phenomenal. It is hardly surprising, therefore, that beginning with 
Flavell’s book in 1963 most of the major publishers have now produced 
at least one text which attempts to explain complicated Piagetian 
theories to unsophisticated students of psychology and of education. The 
appearance of a book such as Athey and Rubadeau’s is also, therefore, 
no great surprise. Nor, unfortunately, is it likely to create much of a 
stir in teacher-education circles. 


True, the book provides an excellent collection of articles which report 
research based on Piaget’s theories and at least in some way related to 
the classroom. Indeed, most of the names that have come to be as- 
sociated with Piagetian research on this continent are represented in the 
text. This is almost inevitable since the book contains forty-one articles 
—yet it is only a 376 page paper back (including the bibliography). 
The large number of articles in so few pages has been made possible 
by editing and abridging many of the articles—a feature which might 
appeal to the Piagetian researcher, but which is not likely to improve 
the clarity of the material for the reader who is not already well versed 
in both Piagetian terminology and contemporary research methodology. 
This is likely to be the major disadvantage of this text as it competes 
with others at the undergraduate level in education. There is little doubt 
that those books which are not collections of research articles, but which 
are directed toward elucidating the educational implications of Piaget’s 
work will fare far better in this market. This is particularly true since 
the authors make little or no attempt to explain the articles which are 
reprinted in the text, or to integrate them by relating them to one an- 
other or to a central theme. 

On the other hand, more advanced (graduate) students, and researchers 
in the field who are not already familiar with the readings collected here, 
might profit considerably from its use as a sourcebook. Among its ad- 
vantages in this role are its excellent bibliography, the fact that most 
of the extraneous material has been deleted from the articles, and the 
organization of content by area (ie.—general implications, implications for 
early childhood education, for the educationally handicapped, for language 
and art, for science and mathematics, and for test development). 

In summary then, while the book does represent a well organized and 
comprehensive collection of Piaget-cum-education based articles, since 
these are frequently abridged and since the authors provide little explana- 
tory comment, the text is likely to prove much too difficult for the person 
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who should be most concerned with Piaget and the classroom—the teacher. 
On the other hand, researchers and instructors in teacher education in- 
stitutions will find it a valuable sourcebook. 


GUY R. LEFRANCOIS 
The University of Alberta 


LANGUAGE AND THINKING IN THE ELEMENTARY SCHOOL 
By E. Brooks Smith, Kenneth S. Goodman, and Robert Meredith. New 
York: Holt, Rinehart and Winston, 1970. 376 pp. 


Although many advances have been made recently in the disciplines 
which examine language, these advances have not always been reflected 
in instruction in language in the elementary schools. At present the gap 
between what is known about language and language learning and what 
is taught in the schools under the guise of a language program is creat- 
ing considerable tension. Smith, Goodman and Meredith have attempted 
not only to integrate knowledge from a diverse array of disciplines con- 
cerned with language, but also to construct a theory of language instruc- 
tion which is congruent with the resulting integration. 


The authors put forward the concept of a language-centered approach 
to teaching and learning. In this view, education is a process of “trying 
to put the world together” (p. 81) by means of symbolic transformation 
of experience. This process is seen to involve three phases: (1) Perceiving 
new data in the environment, (2) Ideating upon the perceptions, (3) Pre- 
senting ideations to one’s self and others. Language is considered to play 
an integral role in this process both as a means of presenting one’s ideations 
and as a means of manipulating one’s perceptions of the world. While 
this view is strongly cognitively oriented, the authors do not overlook 
the importance of non-cognitive factors, such as affect, in language. 
Discussion of instructional strategies in the book are related to the above 
three phases of “coming to know” in a language-centered education. 


The discussion of school programs in language follows directly from 
the more general concept of language-centered teaching and learning. 
Indeed, it is one of the strengths of this publication that instruction in 
language is related to a larger view of education and of language develop- 
ment. The program put forward envisages an attempt to diagnose students’ 
needs and strengths in language and an attempt to develop ideation in 
widening experiences with children thereby forcing an expansion of the 
language already present. The authors hope in this way to continue de- 
velopmental trends already present prior to school entry. They feel that 
the child’s own language has been the least used resource in language 
instruction (p. 163). Knowledge about language in this program is valued 
only as it contributes to effective, flexible language use. In brief, the 


emphasis is upon providing experiences which provoke interpretation and 
thereby expand language proficiency. 
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The authors discuss each of the traditional areas of language instruc- 
tion, such as oral and written communication, (or speech-thought and 
written-thought as they are called), reading, literature and the other 
areas in the light of their position. While it is true that much space is 
devoted to the discussion of possible teaching strategies and techniques, 
much of this discussion is at a very general level and appears to assume 
a reader with some teaching experience. 


Too often language publications imply that the good language teacher 
is the one who smiles sweetly and reads poetry with vibrant enthusiasm. 
In their attempt to see language instruction as integral to the child’s 
creation and interpretation of his world, Smith, Goodman and Meredith 
have broken tradition with this “sweetness and light” genre of language 
publication. The attempt to influence the language-thinking skills of young 
learners demands considerable knowledge of language and language 
learning as well as the subtle ability to help the child focus upon his 
experience in an attempt to create a personal symbolic interpretation. 


The authors have ranged far and wide through the disciplines con- 
cerned with language. They have incorporated ideas from such fields as 
linguistics, psychology, psycholinguistics, semantics, and the philosophy 
of language. While knowledge of all of these disciplines is required if 
language is to be considered in any depth, the attempt to cover the field 
often leads to superficial consideration of important issues. An example 
of one such issue is the sketchy discussion of the differences between 
oral and written languages. 


The section dealing with reading appears to adequately summarize the 
work of Goodman which had been published previously throughout a 
variety of journals. Unfortunately few new ideas are introduced and this 
section appears strangely unrelated to the remainder of the book. 


The book appears to be an ambitous undertaking which, while it has 
not entirely achieved its goal, is a worthy addition to the field of language 
publications. The book will probably appeal to students and teachers 
with some background in language instruction, particularly those with a 
cognitive orientation. In addition, those interested in research may find 
some interesting opinions expressed which appear amenable to research. 


R. K. JACKSON 
The University of Alberta 
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MRC HUR ELLIOTT 


Simon Fraser University 


Predicting Success in Teaching 


A random sample of 60 graduates of the Simon Fraser Professional 
Development Program was used to study predictors of success in pro- 
fessional teaching. The criterion variable ‘‘success’”’ was defined as the 
level of teaching performance as rated on a five-point scale by super- 
visors in school systems. The predictor variables found to be most close- 
ly correlated with success were (1) the student teachers’ grade in Edu- 
cation 405, a 16-week experience in the classroom; and (2) the students’ 
matriculation (grade 12) average. By means of a step-wise regression 
analysis it was possible to develop a predictor equation. The multiple 
correlation coefficient between predictors and criterion after appro- 
priately weighting the three best predictors was found to be .49. 


Over the years researchers have attempted to identify human traits 
and abilities useful in the prediction of success in teaching. They argue 
that if these qualities are identified, the selection of candidates for 
teacher education would become a much more systematic and efficient 
process. Commissions on education, without fail, emphasize the prime 
importance of establishing reliable criteria for teacher selection. Two 
reports from different sections of Canada state: 

Universities should adopt a screening policy for applicants to the teach- 

ing profession. Even more important than academic qualifications is the 

ability to relate to people. (Commission on Education, British Columbia 

Teachers Federation, 1968); and 

The committee is convinced that improvement in the selection and edu- 
cation of teachers is fundamental to the improvement of education in 
Ontario. (Hall-Dennis Report, Ontario Department of Education, 1968.) 


Approaches to Predicting Success 


At a time when teacher supply is catching up with demand, the above 
recommendations take on new significance. It is proposed in this paper 
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to consider two approaches to the problem of predicting success in 
teaching: 

1. the traditional approach which has been an attempt to identify 
those human traits and qualities which are likely to lead to success, and 

2. the approach being used at Simon Fraser University which is to 
augment the traditional approach through the identification of indivi- 
duals who are likely to succeed. This identification comes reasonably 
early in the Professional Development Program, so that those unlikely 
to succeed may opt out without great loss of time or money. 


Personality and Attitude Measures 


Numerous attempts have been made to systemize the process of pre- 
dicting success in teaching by means of measures of the individual’s 
personality and attitude. These have had two definite limitations: 
(1) they attempted to predict success in student teaching, not in pro- 
fessional teaching; (2) few significant correlations were found. 

Michaelis (1954), using 271 student teachers as subjects, completed 
a comprehensive study at the University of California entitled “The 
Prediction of Success in Student Teaching from Personality and Attitude 
Inventories.” Instruments used in the study included the Minnesota 
Multiphasic Personality Inventory, The Heston Personal Adjustment 
Inventory, The Minnesota Teacher Attitude Inventory, The Minnesota 
Personality Scale, and The Minnesota Thinking—Social—Emotional— 
Inventory. Having done an extensive analysis of the correlations be- 
tween personality variables and student teachers’ performance, Michaelis 
was forced to conclude that. no combination of the sub-tests employed 
in the study was found to have sufficient predictive efficiency to warrant 
its use in a selection program designed to identify the best and the 
poorest student teachers. 


Similar disappointing results were obtained with the Minnesota 
Teacher Attitude Inventory by Sangren and Schmidt (1956) who, using 
393 student teachers as subjects, found that scores on the instrument 
bore no relationship to supervisors’ evaluations of teaching performance. 
Durflinger (1963), using the Psychological Examination of the American 
Council on Education, obtained correlations of -.08,-.18, and -.13 when 
quantitative, linguistic and total scores were compared with supervisors’ 
ratings of student teachers. Burkard (1965), again using the MTAI, found 
it unreliable as a predictor of teaching effectiveness. An _ interesting 
question is why such studies continue to be done when there have been 
so many disappointments. 

A slightly different approach described by Gough (1968), suggests 
that an assessment of ‘folk dimensions” of interpersonal and _inter- 
actional behavior may be more useful in predicting teaching performance 
that the traditionally-used psychological dimensions. Scores on the 
California Psychological Inventory, an instrument developed by Gough, 
were obtained for 298 student teachers and these were compared to 
ratings assigned by their supervisors. By means of a step-wise regres- 
sion analysis, those psychological variables with the higher predictive 
Beta weights were obtained. These were: psychological mindedness, 
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achievement-via-conformance, socialization, good impression (nega- 
tive predictor) and flexibility (negative predictor). A regression equation 
using these five predictors was developed which provided scores correla- 
ting at the +.36 level with the criterion variable, student-teacher per- 
formance. 


Having obtained this modest predictor, the next step was to describe, 
in everyday language, the personal qualities of those scoring well on 
the C.P.I. To do this, each subject was rated by five of his peers on the 
Adjective Check List (Gough and Hillbrun, 1965). It is interesting that 
a slightly different configuration of common personality traits appeared 
for males who scored high on the C.P.I. than for females. A summary 
of these qualities is presented in Table 1. 


TABLE 1 
TERMS USED MOST TYPICALLY BY STUDENT-TEACHERS IN 
DESCRIBING THEIR PEERS 
Male Students Female Students 

Scoring High Scoring Low Scoring High Scoring Low 
on the C.P.I. on the C.P.I. on the C.P.I. on the C.P.I. 
conscientious reckless dominant curious 
practical daring persevering affectionate 
rational pleasure-seeking persistent careless 
moderate spendthrift serious easy-going 
methodical irresponsible opinionated unconventional 
planful flirtatious ambitious dreamy 
responsible show-off demanding understanding 
logical spontaneous logical irresponsible 
reasonable adventurous rigid cheerful 
capable mischievous clear-thinking natural 
thorough quick determined individualistic 
reserved careless responsible thoughtful 


Note—Terms are listed in descending order of frequency. 


This summary, would suggest that the male scoring highest on the 
C.P.I. is a diligent, well-organized, conscientious individual who is atten- 
tive to the practical demands of his work and can be counted upon 
to display discretion and good judgment. In the case of the female, the 
emphasis appears to be more upon her drive, resolve, firmness and her 
recognition of need for insightful and responsible behavior. Although 
this high-scoring female might appear to her colleagues to be somewhat 
dogmatic and inflexible, these same qualities may well be viewed by 
her pupils as decisiveness, clarity and the condition of being well or- 
ganized. 

Whether Gough’s research findings will be useful in selection of 
teachers will depend upon repeated testing and replication. Meanwhile, 
his claim is that the “verbal portraits’ above possess more reliability 
in prediction than the traditional psychological inventories. 
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Simon Fraser Program in Professional Development 


As a consequence of the limited success thus far experienced in iden- 
tifying personality traits useful in prediction, the Simon Fraser Program 
in Professional Development has focussed attention upon the identifica- 
tion of the individual likely to be successful. The author has made an 
attempt to assess some of the outcomes of this model, in use since 1965. 


The assumption is made at Simon Fraser that in the selection of 
teachers, one can not completely rely upon academic records, personality 
inventories and pre-admission interviews. Although these criteria are 
useful, many persons will enter the Professional Development Program 
who are not suited to the teaching profession and will not be happy or 
successful in it. Consequently there should be ample opportunity for the 
individual to determine his suitability for the profession well in advance 
of the time when a decision must be made regarding his certification. 


There are a number of ways in which this is achieved. Before the 
student is admitted, not only are the usual academic records scrutinized, 
but he is also asked to describe his reasons for wishing to become a 
teacher and to indicate prior experiences which relate to child care, super- 
vision of children’s playgrounds, tutoring, etc. In many cases, where 
the standard criteria are borderline, experiential criteria may be the 
deciding factor. 


When the student is admitted he is immediately sent to a school as 
part of a team of three or four students where he assumes a small 
share in the responsibilities and challenges of the classroom. This por- 
tion of the program, Education 401, continues for eight weeks and is 
followed by another eight-week period, Education 402, of on-campus 
study. During the following sixteen-week period, Education 405, the stu- 
dent is again in the classroom, not as part of a team but as an indi- 
vidual who will during that time come to assume a large share of the 
teaching responsibilities. Another sixteen-week semester of study on 
campus, Education 404, completes the Professional Development Pro- 
gram. It is believed that during these several phases it is possible to 
predict with reasonable accuracy the criterion variable, success in 
teaching. 


Research Problem 

Studies which were reviewed in the first section of this paper used 
as their criterion variable, success in student teaching. The report which 
follows goes one step beyond this, to consider success in professional 
teaching. (It should be pointed out that data related to success in pro- 
fessional teaching are difficult to obtain since persons in administrative 
or supervisory roles hesitate to release such data even though complete 
confidentiality is assured.) 

The study involved the identification of predictors of success in teach- 
ing and to rate these in terms of their predictive efficiency. The pre- 
dictors were: 

1. junior matriculation average, 


2. grade point average in university courses prior to entering the 
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Professional Development Program, (two years of university education 
is minimum for entry), 


3. standing in Education 401, (first eight weeks of program—in 
schools), 


4. standing in Education 402, (following eight weeks, on campus), 


5. standing in Education 405, (following sixteen weeks, in schools 
on an individual basis), 

6. standing in Education 404, (following sixteen weeks, on campus; 
some students take Education 404 before Education 405). 

The criterion variable was success in professional teaching as rated 
on a five-point scale by supervisors in the British Columbia school sys- 
tem. 

The sample consisted of a random selection of 60 students who had 
graduated from the Simon Fraser Professional Development Program 
during the period 1966-1968, and who were, in 1969, teaching in B.C. 
schools. 

Table 2 suggests that there are at least three predictors which might 
be used in combination to develop a more effective combined predictor 
of the variability of success in teaching. A stepwise regression analysis 
(Draper and Smith, 1966) was then applied to the data to determine 
how much of the variance of the criterion could be predicted using a 
combination of the independent variables. 


TABLE 2 
CORRELATIONS OF INDIVIDUAL PREDICTORS WITH TEACHING SUCCESS 


Correlation with Rated 
Success in Professional Significance 


Predictor Teaching (N=60) Level 
Junior Matriculation Average fOLOy 05 
Grade Point Average 

(at University, prior to 

teacher education) .2060 N.S. 


Education 401 
(8 week program in classroom, 


in teams) .0188 N.S. 
Education 402 

(8 week program on campus) 0594 N.S. 
Education 405 

(16 week program in classroom, 

Individual) 3338 05 
Education 404 

(16 week program on campus) 0835 N.S. 


ee ee 


Three of the predictors appeared to be the principal ones account- 
ing for the variance in teaching success. In the stepwise regression pro- 
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cedure the best predictor is selected first and is followed by the one 
which accounts for the next highest amount of remaining variance, and 
so on. Table 3 records the variance accounted for by the three best 
predictors, viz., Education 405, Junior Matriculation Average and Edu- 
cation 401, 402, 404 (combined). 

It is interesting to note that in this analysis, grade point average 
at university (prior to the Professional Development Program) does not 
appear as a prime predictor, even though Table 1 shows it to have a 
correlation with the criterion variable which is just short of the signifi- 
cant level. One explanation for this is that Junior Matriculation Average, 
which is a better predictor, is selected first in the analysis and has sub- 
sumed much of the variable of academic competence contained in uni- 
versity G.P.A. 


TABLE 38 
BEST COMBINATION OF PREDICTORS OF SUCCESS IN TEACHING (N=60) 


Per Cent of Variance in 
Predictor Criterion Accounted For 


Education 405 


(16 week program in classroom, individual) ; 11.14% 
Junior Matriculation (Gr. 12) Average 9.32% 
Education 401, 402, 404 (combined) 3.81% 
Total Variance Accounted For: 24.27% 
Multiple correlation coefficient for the above three predictors: .4926! 


1 Significant at the .001 level. 


Implications for Teacher Education 


Findings from this study lead one to question some current beliefs 
about teacher education and to support some others. 


The practice of grouping student teachers in teams when they are 
placed in classrooms has many advantages, but predictability of ulti- 
mate success is not one of them. Correlation between the performance 
of students in this situation and their ultimate performance is close to 
zero. By contrast, the ratings students receive when assigned individually 
to classrooms (Education 405) correlate at a higher level with ultimate 
teacher performance than any other predictor considered (r = .33). One 
might conclude that when a student.is placed in a classroom, as a member 
of a group, his opportunity to perform is limited and his visibility low. 
Any assessment of his potential as a teacher, in this situation, would 
appear to differ little from a chance assessment. However, when there 
is a one-to-one relationship between student teacher and _ professional 
teacher, over an extended period, the assessment of his performance is 


74 


Success in Teaching 


a respectable predictor of ultimate success. This finding lends empirical 
support to such statements as the following by MacDonald (1970): 
“Teacher education must cease to be the exclusive responsibility of 
universities and colleges and become the overt concern of the whole 
educational system (p. 17).”’ 

The second best predictor of success in teaching was found to be the 
Junior Matriculation (Grade 12) average, (r = .31). This is not surprising 
since the grade twelve curriculum and its related evaluation procedures 
tend to be somewhat standardized within provinces and between pro- 
vinces in Canada. It could be said that persons who have learned to 
accommodate to the educational system as students will readily accom- 
modate to the system as teachers. This is not to say that these people 
are necessarily conformists, but rather that they are able to co-operate 
with others in an enterprise which has both individual and organiza- 
tional objectives. It is well documented that the “best single predictor of 
success in University is the high school average (Lavin, 1965).” Thus, 
one would be surprised if this study had not confirmed the matricula- 
tion average as the best predictor among scholarship variables. 


The results of this study must be viewed with caution since they are 
based upon correlational, not experimental investigations. Any conclu- 
sions drawn should be stated as correlations between variables rather 
than as cause-and-effect relationships. Within these limitations what 
does the study suggest to those responsible for teacher education? 


1. Personality variables, though generally considered important in 
teaching, have been difficult to identify and have not shown great pro- 
mise as reliable predictors of teaching success. 


2. “Folk dimensions” of interpersonal behavior, (Gough, 1968) may 
be more useful as a guide in the identification of prospective candidates 
for teaching. 

3. The best “scholarship-type” predictor is the grade twelve average. 

4. The best predictor of all appears to be the extended (16 week) 
experience in the classroom in which a student works closely with a 
professional teacher and gradually assumes professional responsibility. 


It now appears possible to develop through regression analysis a 
combined predictor, using personality, scholarship and _ experiential 
variables which will predict success in teaching with greater and greater 
reliability. If public education is to meet an ever-increasing societal 
obligation and challenge, an up-grading in the effectiveness (success) of 
the professional teacher is essential. Since teaching is a life-time career, 
the time to influence the quality of teaching in the year 2000 is now; 
one way to influence it is through a program of teacher selection and 
teacher education based upon what we do know, and can learn, about 
the predictability of teacher performance. 
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Effects of Visual Discrimination Training on 
Immediate and Delayed Word Recognition 
In Kindergarten Children! 


The study compared 20 groups of kindergarten children learning to read 
and to recall words following different kinds of visual discrimination 
training. Groups were designated by kind of training, kind of word, and 
sex. The kinds of training included same words as reading task, same 
letters which were constituents of reading words, different meaningful 
words (presentation of visual form, pronunciation, and picture) and 
combinations of same-letters and different-meaningful-words. Half the 
groups learned to read words similar in configuration and sounds; the 
others learned dissimilar words. Results of analysis of variance indi- 
cated no significant differences on immediate or delayed recognition 
task for kind of training or sex but kind of word was consistently signi- 
ficant. Similar words were more difficult than dissimilar words to dis- 
criminate, to learn to read, and to recognize later. 


The present study is an extension and partial replication of the con- 
ditions that led to significant findings in four previous studies relating 
to the effects of various kinds of visual discrimination training on teach- 
ing children to read words. 

In the first study (Muehl, 1960), three groups were given visual dis- 
crimination training with different symbols: words that appeared on a 
subsequent reading task, words that did not appear on the subsequent 
reading task, and geometric forms. The group that had been trained to 
discriminate among the same words that appeared on the reading task 
learned to read the words faster, but there was no difference between 


1 The authors wish to thank the Alberta Advisory Committee on Educational Research, the University of 
Iowa, and the participants in the study. : 
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the different word and geometric form groups. This finding suggests that 
visual discrimination training should be closely related to the specific 
words to be learned in beginning reading. 

Another study (Muehl, 1961) was designed to determine whether 
children were attending more specifically to the configuration of the 
word or the individual letters in the word. Specific letters were more 
important cues than the shape of the word in learning to read. | 

King’s study (1964) contained a partial replication of Muehl’s earlier 
studies using words and letters in visual discrimination training which 
were relevant to the reading task. In addition, training with different 
words that were meaningful was compared to the training with the same 
words and the same letters. Words were made meaningful to the child 
by the accompaniment of an appropriate picture and pronunciation with 
the visual form. The findings indicated that when various types of dis- 
crimination training are contrasted in terms of their effectiveness in 
helping children learn to read a list of words, training to respond to 
printed symbols as meaningful units and training to discriminate among 
letters appearing in the reading words were the most effective proce- 


dures. 
In a subsequent study (King and Muehl, 1965), the effects of learning 


to read different kinds of words were investigated. Groups of words 
which were similar in configuration and contained some of the same 
phonemes were more difficult to learn to read than dissimilar words 
and appeared to interact with training conditions. 


In all the above studies, the effects of various types of visual dis- 
crimination training were determined with a reading task that followed 
immediately after the discrimination training. What ever transferred to 
the reading task was recalled and applied on a short term basis. In a 
practical reading situation what is transferred and recalled over a long 
time interval is obviously of greater importance than what is effective 
in the short interval. What transfers immediately may be the same as that 
which transfers over a longer period or time or it may not. It is 
possible that visual discrimination training effectiveness may vary, given 
the time interval between that training and when the words have to be 
learned or recalled. 


In addition to the recall factor, sex differences in reading achievement 
are apparent in performance on standardized reading tests, beginning as 
early as first grade (Bond and Dykstra, 1967). Although this difference 
exists there is little specific evidence to indicate what variables operate 
to produce the difference. 


The present study was designed for two purposes: (1) to investigate 
further visual discrimination training procedures suggested by the earlier 
studies, and (2) to consider the relation of these procedures to recall, 
kinds of word, and sex differences. The following specific questions 
were posed: 


‘1. If training children to respond to words as meaningful units and 
training in letter discrimination are equally effective in preparing 
children to read words, would a combination of these types of discrim- 
ination training produce an even greater facilitation? 


78 


Visual Discrimination Training 


2. If similarity among words is a factor that interacts with training 
for reading, would the differential effects appear if the training tasks 
are extended to cover words highly similar and dissimilar in visual 
and auditory forms? 


3. Do the methods of visual discrimination training and the similarity 
of the words contribute to differential effects on a delayed recall task? 


4. In what ways do the above factors relate to the sex of the subject? 


Procedure 
Design of the Study 


The study was planned in three main parts: discrimination training, 
reading tasks, and recall tasks. Subjects were given different kinds of 
visual discrimination training prior to learning to read a common list 
of 4 words. A recall test on the 4 words used in the reading task was 
administered 24 hours later. 


Five kinds of training were used in training subjects to read a list 
of 4 similar words. The same methods of training were repeated using 
different subjects learning to read a list of 4 dissimilar words. Each of 
these 10 groups was further divided into female and male groups mak- 
ing a total of 20 groups as shown in Table 1. 

The main statistic used in analyzing the data was an extension of the 
Lindquist (1953) Type III analysis of variance. The between factors in- 
cluded kind of training, kind of word, and sex; the within factor included 
learning trials. Analyses were conducted on the number of correct re- 
sponses on the training, reading, and recall tasks and on the errors and 
omissions on the reading and recall tasks. 


Materials and Method 


A kindergarten-sized table and 2 chairs were provided in a classroom 
apart from the regular classroom. A sloping wooden stand was placed 
on the table to hold the training and reading materials. 


Training Tasks. Loose-leaf books, 8'’2 x 11 inches, were used in train- 
ing and training familiarization. The pages were of heavy white paper, 
covered with acetate to protect them from handling. Training stimuli 
were presented halfway down on the left side of the page. Four response 
choices were presented on another page the same distance down, but 
in a position to the right of the stimulus. The response choices were en- 
closed in hinged acetate pockets with the correct choice indicated by a 
gold star underneath the pocket. A blank page appeared between the 
page with the stimulus and the one containing the response choices to 
provide for a successive method of presentation. 

The stimuli used in familiarizing the subjects with the discrimina- 
tion training were the same for all groups and consisted of geometric 
figures in outline: circle, square, triangle, and cross. One trial con- 
sisted of presenting each of the 4 stimuli and accompanying response 
choices. Subjects who did not make 4 correct responses on the second 
familiarization trial were eliminated from the analyses. 

The training stimuli included: letters, words, words accompanied by 
pictures, and some combinations of these stimuli. Word and letter stimuli 
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were typed in lower-case letters on a primary typewriter. The pictures 
were outline drawings in black ink. All words selected contained 4 
letters to hold the length constant. “Similar” words were chosen to pro- 


TABLE 1 
VISUAL DISCRIMINATION TRAINING GROUPS 


Kind of Word Number 
Kind of Training Similar (S) Dissimilar (D) of 


Female (F) Male(M) Female(F) Male(M) Trials 


Same-Word (SW) Group | 
Words which are the same Group 2 8 
as reading words. Group 3 
Group 4 


Same-Letter (SL) Group 5 
Letter constituents of Group 6 8 
reading words. Group 7 
- Group 8 


Different-Meaningful- Group 9 
Word (DMW) Group 10 8 
Words different from Group 11 
reading words. Presenta- Group 12 
tion of appropriate picture 
and sound with visual 
form. 


Same-Letter and Different- Group 13 
Meaningful-Word Group 14 4+4 
(SL+DMW) Group 15 

Training with same-letters Group 16 

for 4 trials followed by 

different-meaningful 

words for '% trials. 


Different-Meaningful-Word Group 17 
and Same-Letter (DMW+SL) Group 18 4+4 
Training with different- Group 19 
meaningful-words for 4 Group 20 
trials followed by same- 
letters for '% trials. 


vide words which were approximately the same in configuration and con- 
tained many of the same phonemes. In contrast, the “dissimilar” words 
were selected because of their differences in configuration and phonemes. 

When the stimulus for a trial was a word or a word and picture, 
the response choices were 4 similar and dissimilar words appropriate to 
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the task. When the stimulus was a letter, the response choices were 
the letter constituents of the word appropriate to the task. Letters for 
the remaining words were presented in like manner. A total of 8 train- 
ing trials was presented to each subject. 


The words which were used both as stimuli and response choices 
for the Same-Word Groups were the words appearing in the reading and 
recall tasks: find, food, feed, foot for the similar words (Group 1 - female 
and Group 2 - male) and fork, gate, drum, nest for the dissimilar words 
(Group 3 - female and Group 4 - male). The letters which served as 
both stimuli and response choices for the Same-Letter Groups were the 
letter constituents of the words used in the reading and recall tasks. Be- 
cause of some double letters in the similar words for 2 of the Same- 
Letter Groups (Group 5 - female and Group 6 - male), stimuli f, i, n, d; 
f, o, o, d; f, e, e, d; f, 0, o, t were presented with the correct response and 
3 other randomly selected incorrect response choices from the letters 
f, i, n, d, 0, e, t. For dissimilar words in the Same-Letter Groups (Group 
7 - female and Group 8 - male), the letter stimuli and response choices 
were f, o, r, k; g, a, t, e; d, r, u, m; n, e, s, t. In the Different-Meaning- 
ful-Word Groups, word stimuli were used which were different from the 
words to be presented in the reading and recall tasks: doll, ball, bowl, 
bell for the similar words (Group 9 - female and Group 10 - male) and 
hand, coat, girl, shoe for the dissimilar words (Group 11 - female and 
Group 12 - male). The visual form of these words was, in each case, 
accompanied by an appropriate picture and pronunciation of the word. 
The stimuli used for the Same-Letter Groups and the Different-Meaning- 
ful-Word training were combined in 2 sequences for the remaining 
groups. One sequence was the presentation of 4 training trials with 
Same-Letters followed by 4 training trials of Different-Meaningful-Words 
for the similar words (Group 13 - female and Group 14 - male) and 
for the dissimilar words (Group 15 - female and Group 16 - male). The 
other sequence was the reverse order of presentation of 4 trials of Dif- 
ferent-Meaningful-Words followed by 4 training trials of the Same- 
Letters for the similar words (Group 17 - female and Group 18 - male) 
and for the dissimilar words (Group 19 - female and Group 20 - male). 


A presentation consisted of the experimenter exposing a page which 
contained a stimulus for about 2 seconds. During this interval a marker 
was held above the stimulus to focus the subject’s attention on it. He was 
told to look carefully at the stimulus. After the stimulus page had been 
turned over a blank page was shown for about 2 seconds. The next page 
contained the 4 response choices which were exposed for about 4 seconds. 
The subject was instructed to lift the word card that “looks just like” 
the one presented earlier. The 12 groups receiving all or part of their 
discrimination training using different-meaningful-words had _ addi- 
tional instructions. When each word was presented an appropriate picture 
suggesting the meaning of the word appeared above the word. After 
about 1 second, the experimenter placed the marker over the picture 
to focus attention on the word and said, “Look carefully at this word. 
The word is _______.”” When the response choices were shown, the 
experimenter said, “Lift up the word card that says ‘ 
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Within each trial for all groups, the order of stimulus presentation 
and the position of the response choices was varied. Only one selection 
from each set of response choices was permitted. Correct responses were 
recorded on a score sheet. 

Reading Task. Each subject was presented with the reading task im- 
mediately following the training task. Two loose-leaf books, 54% x 8% 
inches, were used in the reading task. The pages were again covered 
with acetate. One book was used for the 10 groups learning to read 
similar words (Groups 1, 2, 5, 6, 9, 10, 13, 14, 17, and 18) and the 
other book was used for the 10 groups learning to read dissimilar words 
(Groups 3, 4, 7, 8, 11, 12, 15, 16, 19, and 20). A familiarization “trial 
was provided for each subject prior to the main presentation of the read- 
ing task words: find, food, feed, foot for the similar words and fork, 
gate, drum, nest for the dissimilar words. 

In familiarization, the subject was asked to look carefully at the word. 
While pointing to the word, the experimenter said, “The word is 
What is the word?” This procedure was used for each of the 4 words 
the subject was to meet on the reading task. 


Subjects were told that more words would be presented. “If you read 
a word correctly, I will tell you and you may put a colored peg in the 
peg board. Look carefully at the word and try to read it before I do.” 
A page was turned over in the book exposing the stimulus word. Dur- 
ing the anticipation interval of about 4 seconds the subject was expected 
to read a word. If the subject gave a correct response the experimenter 
confirmed it and repeated the word. If an incorrect response was given 
the experimenter said, ““No, that word is _______..”” _ If no response was 
give the subject was told the correct word. 


A learning trial consisted of 4 presentations, 1 for each word, in vary- 
ing order. All subjects continued in the reading task to a criterion of 16 
correct responses in 4 complete trials, or for a maximum of 12 trials, 
or 48 presentations. Correct responses, errors, and omissions were re- 
corded on score sheets. 


Recall Task. The same books used for the reading task were again 
used with the same subjects 24 hours later in the recall task. The first 
3 of the 12 trials used in the reading task were presented. However, in 
recording the correct responses, errors, and omissions for the delayed 
recall task, only trials 2 and 3 were reported. Trial 1 was considered a 
“warm-up” trial. The responses were treated in the same way as for 
the reading task, but no peg board was used. 


Subjects 


The subjects were 160 children from 8 community kindergartens in 
Calgary, Canada. Eight subjects were assigned in rotating order to each 
of the 20 groups. Certain subjects (not included in the 160) were omitted 
from the study for the following reasons: 32 did not reach learning cri- 
terion in training familiarization, 1 was a reader, 1 could not speak, 1 
was very emotionally disturbed, and 20 were not present on both days 
in the kindergarten. For all groups, ages ranged from 60 months to 77 
months. The mean age was 67.9 months. There were no significant age 
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differences among groups. Each subject completed the training and read- 
ing tasks in about 20 minutes on one day and the recall task required 
about 3 minutes on the following day. 


Results 
In analyzing the data by trials, the 8 training trials were divided into 
4 blocks of 2 trials each. The 2 trials of the recall task were combined 
into a single score. The 5 per cent level was selected for testing signi- 
ficance. 
Training Task. Table 2 presents the mean number of correct responses 
and standard deviations in training for all groups combined over trials. 


TABLE 2 


MEANS AND STANDARD DEVIATIONS OF CORRECT RESPONSES ON 
TRAINING TASK COMBINED OVER TRIALS 


Group Mean s.d. 
1 SW-S-F 4.03 5.67 
2 SW-S-M 3.20 6.08 
3 SW-D-F 5.62 3.46 
4 SW-D-M 5.09 6.42 
3) SL-S -F 6.94 1.79 
6 SL-S -M 6.41 2.29 
ij SL-D-F 6.87 3.04 
8 SL-D-M 6.69 3.49 
9 DMW-S -F 3.09 4.44 

10 DMW -S -M 3.50 4.64 
id DMW -D-F 5.12 7.92 
12 DMW-D-M 3.84 5.85 
13 SL+DMW-S -F 5.44 3.00 
14 SL+DMW -S -M 4.81 3.38 
15 SL+DMW -D-F 5.34 2.45 
16 SL+DMW-D-M 5.44 1.56 
1 DMW+SL-S -F bial 2.86 
18 DMW+SL-S-M 51 4.66 
19 DMW+SL-D-F 6.47 2.62 
20 DMW+SL-D-M 5.50 4.33 


Note—The key to training group designations is as follows: SW = Same Word; 
SL = Same Letter; DMW = Different Meaningful Word; S = Similar Words; D = Dis- 
similar Words; F = Female; M = Male. 


The analysis of these data revealed a significant difference in the 
number of correct responses according to the kind of visual discrimina- 
tion training. In addition, dissimilar words were significantly easier to 
match than similar words and females performed significantly better than 
males. There was a significant interaction between kind of discrimina- 
tion training and kind of word. Table 3 shows the t-test values obtained 
from comparing all pairs of means for the kind of training with similar 
and dissimilar words. 
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TABLE 3 


t-TEST VALUES COMPARING MEANS OF CORRECT RESPONSES FOR EACH 
KIND OF TRAINING WITH SIMILAR AND DISSIMILAR WORDS 


Kind of 
Training DMW SW SL+ DMW DMW + SL 
Similar Words 
Si A DT* 3.83" 1.96* Wie 
DMW +SL Diya PANG Wi: 24 
SL + DMW 2.30" 1.87 
SW 43 
Dissimilar Words 
SL 8.51* Seta be Abs 2.96* 
DMW +SL Ho 2oO* DiO* 
SL+DMW Bloke ae 
SW a0" 


Note—Key to kind of training is as follows: SL = Same Letter; SW = Same 
Word; DMW = Different Meaningful Word. 


*p<.05 


The order of difficulty of learning for the kind of training was the same 
for similar and dissimilar words. Groups matching letters had the easiest 
task, while groups matching different-meaningful-words had the most 
difficult task. The interaction was due to smaller differences among 
groups matching similar words as compared to those matching dissimi- 
lar words. 


Reading Task. The means and standard deviations for the correct 
responses, errors, and omissions in the reading task for all groups com- 
bined over trials are presented in Table 4. 

The analysis of the data for the number of correct responses revealed 
that the only significant differences were in the kind of word, trials, and 
an interaction between trials and kind of word. Dissimilar words were 
significantly easier and faster to learn to read than similar words. 


In the analysis of the number of incorrect responses, trials were 
significant in the expected direction and a complex interaction was 
found among kind of training, kind of word, and sex. 

The analysis of omissions on the reading task indicated that trials 
were significant in the expected direction. The similarity of the words 
also made a significant difference. More subjects omitted responses to 
similar words than to dissimilar words. 


Recall Task. Table 5 presents the mean number of correct responses 
and standard deviations in the recall task for all groups. 
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TABLE 4 
MEANS AND STANDARD DEVIATIONS ON READING TASK 
COMBINED OVER TRIALS 
Correct Responses Errors Omissions 
Group Mean s.d. Mean s.d. Mean _ s.d. 
1 SW -S - 1.87 6.51 3.31 9.94 2.81 15.05 
2 SW-S- 1.65 6.05 3.96 8.27 2.40 8.93 
a SW -D- 3.23 6.91 3.40 5.27 Lot 4.4] 
4 SW -D- 3.33 7.62 2.56 5.45 1.98 8.85 
5 SL-S - 1.69 6.27 3.90 8.06 201 11.34 
6 SL-S - 1.65 6.58 4.10 10.59 235 12.89 
7 SL-D- 3.54 6.63 3.08 6.12 137 8.93 
8 SL-D- 3115 7.10 3.79 6.12 1.06 3.97 
9 DMW -S - 2.69 5.49 4.10 7.18 ii 6.61 
10 DMW -S - IRAE, p27 3.20 9.33 2.46 15.18 
gis] DMW -D- 3.42 10.77 2.87 6.74 ait 5.02 
12 DMW -D- 2.07 4.66 4.21 3.07 1.08 eee 


2.10 8.12 3.65 7.66 2.20 9.87 
1.90 6.20 4.06 5.15 2.04 phe Gi 
3.10 11.20 3.62 9.67 1:27 5.09 
2.65 5.49 4.40 7.02 0.96 4.24 
1.62 4.24 4.25 6.02 2.06 7.23 
2.02 8.40 3.46 8.90 2.02 14.54 
3.85 8.62 2.98 3.79 1A 6.89 
3.12 8.03 4.23 8.69 0.65 1.27 


LZ DMW+SL-S - 


+3 DMW+SL-D- 
20 DMW +SL-D- 


SYxS~YSaeaeyesrde tsetse 


Note—The key to training group designations is as follows: SW = Same Word; 
SL = Same Letter; DMW = Different Meaningful Word; S = Similar Words; D = Dis- 
similar Words; F = Female; M = Male. 


The analysis of the correct responses in the recall task showed that 
dissimilar words were significantly easier to read on a delayed recogni- 
tion task than similar words. There was also a significant interaction 
between kind of word and sex. Comparisons using t-tests showed that on 
dissimilar words, females performed significantly better than males. 
There was no sex difference on similar words. This finding was reflected 
in the error analysis on the earlier reading task. 

The analyses for both the errors and omissions on the recall task 
showed that, in each case, the only significant difference was in the kind 
of word. Similar words elicited more errors and omissions than dis- 
similar words. 

By inspection, it is obvious that the mean number of correct responses 
on the recall task was greater than for the reading task (Tables 4 and 5) 
in all 20 groups. An examination of the data for the last trial only 
on the reading task indicated that for 17 out of the 20 groups, the 
mean number of correct responses was still greater on the delayed re- 
cognition task. This phenomenon appears to be a classic instance illu- 
strating reminiscence effect (McGeoch and Irion, p. 11) resulting from 
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TABLE 5 
MEANS AND STANDARD DEVIATIONS ON RECALL TASK 


Correct Responses Errors _ Omissions _ 

Group Mean s.d... Mean _ s.d. Mean s.d. 
1 SW -S - 2.50 2.00 OTS 1.56 / as 2.68 
2 SW -S - 2.CO Za 4.50 1.73 Oa 1,30 
3 SW -D- 4.50 2.06 2.62 1.41 0.88 1.05 
4 SW -D- 4.87 1.69 ie7 1.83 12> 1.92 
5 SL-S- VAs 1.20 a2 1.83 2:12 21 
6 SL-S - 2.87 1.54 4.12 1.83 1.00 4 
7 SL-D- 6.00 Le22 Li2o £20 0.75 0.83 
8 SL-D- 3.62 2.06 Dara ZAG 1.62 2.64 
9 DMW -S- atop 1.92 3.50 1.66 125 1.79 
10 DMW -S - Biol 2.26 1.50 1:22 2.62 2.96 
ikl DMW - mp0 R73 L387 es Wes 136 
12 DMW - D- 4.00 2.18 ail? 1.83 0.88 1.69 


3.20 1.39 2:62 1.65 22 1.69 
3.37 Zk 3.62 1.73 1.00 1.50 
5.00 2.29 2:62 1.87 0.38 0.70 
3.75 1.30 3.75 0.83 0.50 0.87 
3.50 1.00 3.87 1.45 0.63 0.99 
3.62 2.39 2.10 1.85 1.62 2.95 
plz 1569 2.37 1.32 0.50 0.71 
4.75 1.64 Or 1.69 0.50 1.00 


14 SL+ DMW - 
15 SL+ DMW - 
16 SL+ DMW - 
LZ DMW + SL- 
18 DMW + SL- 
19 DMW + SL- 
20 DMW +SL- 


peeeryrerererrecer yr 


S 
D 
D 
S) 
) 
D 
D 
13 SL+ DMW-S - 
Ss - 
D- 
D- 
S- 
S - 
D- 
D- 


Note—The key to training group designations is as follows: SW = Same Word; 
SL = Same Letter; DMW = Different Meaningful Word; S = Similar Words; D = Dis- 
similar Words; F = Female; M = Male. 


massed practice. The kindergarten children in this study were subjected 
to an intensive learning situation involving 23 trials or 92 presenta- 
tions during the training and reading tasks in about a 20 minute session. 
The reading task, in particular, proved a difficult task judging by the per 
cent of correct responses. An accumulation of fatigue and decline of 
motivation undoubtedly interfered with attention and response factors, 
especially toward the end of the reading task. The 24 hour respite after 
completion of the reading task and administration of the recall task 
allowed these interfering factors to dissipate with a corresponding in- 
crease in task attention and response availability. 


Discussion 


Previous studies showed that visual discrimination training with in- 
dividual letters and training children to respond to printed words as 
meaningful units were equally effective in preparing children for a 
reading task. The first question of the present study was whether com- 
bining forms of these two kinds of training would make for even greater 
facilitation, compared to either kind of training used exclusively. Based 
on the findings of this study, there was no statistical evidence that these 
combined training methods produced better results than the methods used 
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singly. However, in an examination of the correct response data for the 
reading and recall tasks in Tables 4 and 5 there is a suggestion that 
for similar words, training with meaningful words either by itself or 
combined with letter discrimination training produced better results in 
learning to read than either letter or word discrimination training. 


Similarity in auditory and visual forms of a group of new words 
proved to be of great importance in determining the ease with which 
children learn to read words. Dissimilar words were consistently easier 
than similar words in the discrimination of the visual forms of words 
and letters, in learning to read, and in recognizing the words later. 


The methods of visual discrimination training which facilitated learn- 
ing to read words were equally effective on the delayed reading task. 


Although girls showed a superiority over boys in visual discrimina- 
tion training, this superiority was not transferred to the reading and re- 
call tasks. Overall, sex differences were a function of the difficulty of 
the task. 


Serious consideration should be given to the implications of the find- 
ings of this study for the use of beginning reading materials which control 
the sounds and frequently the resulting visual form of the words. If simi- 
lar words are more difficult to discriminate than dissimilar words, should 
not the period of discrimination training be extended? If groups of 
similar words are more difficult to learn to read, what modifications are 
needed in introducing and reviewing new words? In theory, some 
linguistic approaches claim that introducing reading with words con- 
sistent in spelling and sound patterns facilitates mastery of the most con- 
sistent and frequent sound-spelling relations and generates the idea in 
beginning readers that there is a grapheme-phoneme relation basis to 
learning to decode the written language. The findings of the present 
study combine with common sense to show that groups of highly similar 
words, such as the linguists must use in order to control sound-spelling 
consistency (bin, pin, fin, tin), are difficult to discriminate among and, 
therefore, are difficult to learn to read relative to words that are dis- 
similar in spelling-sound profiles. Some research needs to be done to 
assess the net effect of these two variables operating in the same situa- 
tion. Does the hypothesized reading facilitation due to phoneme-grapheme 
consistency override the confusing effect introduced by using groups of 
highly similar words in visual and auditory discrimination training? 
What teaching strategies should be considered to reduce the negative 
effects of word similarity in certain linguistic approaches, regardless 
of its negative influence? 
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Using Words and Pictures in 
Foreign Language Learning 


An experimental investigation was made to compare the effectiveness of 
using written words and pictures as cues for children’s acquisition of 
vocabulary in a foreign language (Spanish). Eighty-two children in 
Grade 4, 5 and 6 learned ten Spanish words in a paired-associate learn- 
ing situation. The stimulus items were five native-language concrete 
nouns and five pictorial representations of objects. Oral responses were 
required, in the form of the Spanish word equivalents. Learning occur- 
red in significantly fewer trials with the pictures than with the words. 
The effects of age and sex were not significant. In a long-term retention 
test given one week later, performance paralleled that of the original 
learning session, with the majority of the children recalling more of 
the responses learned to the picture items than to the words. 


Research into the learning of foreign languages has most often taken 
the form of comparisons of acquisition under different methods of teach- 
ing (Howe, Gordon & Willman, 1969). There have been numerous com- 
parisons between modern audio-lingual approaches, which emphasize 
the primacy of speech, and cognitive code-learning approaches, in which 
greater importance is attached to grammar and translation. The results 
typically show no overall superiority for one type of method over the 
other (e.g., Chastein and Woerdehoff, 1968), but students who have 
learned by audio-lingual methods sometimes score higher in speaking 
ability than students who have been taught by cognitive methods, where- 
as students taught by modern cognitive code-learning methods some- 
times have better grammar and writing skills than audio-lingual students 
(Scherer and Wertheimer, 1964). The statement by Crothers and Suppes 
(1967, p. 4) that “no existing psychological or linguistic theory can 
account for any substantial portion of the systematic details of language 
learning” remains valid, and there is little unambiguous evidence that 
would clearly indicate benefits of any particular approach or technique. 


Interpretation of the findings of investigations that provide broad 
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comparisons between methods is hindered by the difficulty of ascertain- 
ing which combination of the typically large number of differences 
produced an observed difference in learning performance. This difficulty 
is avoided in simpler experiments that examine the separate sub-skills 
required in learning a foreign language. The present study concerns 
vocabulary acquisition. Although learning vocabulary items is but one 
of the various sub-skills required in foreign language learning, it is 
undoubtedly important, and it would be very useful to know what are 
the optimal learning conditions for acquiring the foreign language re- 
ferents for specific words. 


Kopstein & Roshal (1954) and Wimer & Lambert (1959) used paired- 
associate tasks to examine learning under conditions in which written 
words or pictorial representations of them formed the stimulus items. 
Responses took the form of the written foreign language referents. 
Learning was generally more successful when the stimulus items were 
pictures than when word-word pairs were used. This finding is consis- 
tent with Paivio’s (1969) evidence that in a variety of simple learning 
tasks performance can be facilitated by conditions that encourage non- 
verbal mediation, requiring some kind of visual imagery. The use of 
pictorial stimulus items would seem to favor the occurrence of non- 
verbal mediation. Bugelski (1970), who provides further evidence for 
the greater effectiveness of strategies whereby learners are encouraged 
to use imagery in the learning of word lists, rather than verbalizing, 
points out that subjects who are instructed to verbalize frequently re- 
port the use of imagery even when they are not instructed to form images. 


Foreign language instruction generally aims to provide the learner 
with the ability to speak as well as write in the chosen language. There- 
fore it would be useful to determine the relative effectiveness of pic- 
torial and word stimulus items when the foreign language referent has 
to be provided in the form of an oral response. A study by Deno (1968) 
examined paired-associate learning of foreign language word items with 
verbal and pictorial representation of stimulus items in lists made up of 
Similar or dissimilar concrete word items. The adult learners in his ex- 
periment had to pronounce the Japanese word responses in each pair. 
It was found that pictorial representation of items led to learning in 
fewer trials than verbal representation in the case of lists made up of 
similar words, but there was no difference in learning between the verbal 
and pictorial conditions when the stimulus words in the lists were 
dissimilar in meaning. 

The present study investigated foreign language acquisition in 
school-age children. Learning under conditions using picture and written 
word items was compared in a task whereby learners were required 
to say aloud the Spanish language equivalents. The experimental subjects 
were school children in Grades 4, 5 and 6, and in addition to the learn- 
ing task there was a comparison of their long-term retention under the 
different procedures. 


Subjects stated 


A total of 82 English-speaking children, attending a private school 
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in a suburb of Boston, Massachusetts, served as subjects. No child had 
any knowledge of Spanish, but all took lessons in French. There were 
26 children in Grade 4, 28 in Grade 5 and 28 in Grade 6, and their 
mean ages were respectively 9.3 years, 10.2 years and 11.3 years. I.Q. 
means and SDs were approximately equivalent for the 3 grades. 


Materials 


Each child learned ten Spanish words, five paired with a picture and 
five paired with the English word equivalent. Spanish was chosen be- 
cause it was unfamiliar to the learners, and the words used were ones 
that are relatively easy for an English-speaking person to pronounce. 
Each item was a duosyllabic concrete noun without English or French 
cognates, having an English-language equivalent among the 100 most 
frequently used English words (Thorndike and Lorge, 1944). To balance 
the experimental design two stimulus items, one written and one pic- 
torial, were made for each Spanish word. Each word or picture item was 
colored and appeared on an 8” by 11” card. To test the identifiability 
of pictures, eight 8-year old children were asked to say the one word 
that they thought each picture represented. Only pictures correctly 
identified by all eight children were used in the experiment. The Spanish 
words were presented by tape-recorder. For half the subjects the first 
five items were presented with the appropriate pictorial cue, and the 
remaining five items were paired with the corresponding written cue. 
For the other children this order was reversed. Within each group of 
five words the order of items was randomized across trials. In addition, 
the Spanish words that were paired with visual cues for half the chil- 
dren were paired with written words for the others. 


Procedure 

Each child participated individually. A complete trial consisted of 
one 5-second exposure of each of the ten cues. On the first five trials 
the subject heard a recorded Spanish word and simultaneously saw the 
appropriate picture or English word cue. Two seconds later the child 
heard the Spanish word again, and repeated it aloud. Two seconds after 
the 5-second presentation the next item would occur. The subsequent trials 
(Trial 6 and on) were of the same duration and item order, with word 
order within form (word or picture) randomized between trials, and re- 
quired independent oral reproduction by the child of each Spanish word. 
The child saw a picture item or English word and had three seconds in 
which to attempt oral recall of the appropriate Spanish word. He then 
heard the correct Spanish word and repeated it aloud. This sequence 
continued for each trial until the subject achieved one perfect trial. 
A long-term retention test was given one week after the original learn- 
ing session. On this occasion each child was shown the cue with which 
he had learned each Spanish word and was allowed five seconds in which 
to attempt oral recall. 


Learning Criterion and Scoring 


The words produced by the subjects on learning and long-term recall 
trials were scored on the basis of whether predetermined phonetic 
features indicating adequate reproduction were present or not. Perfect 
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pronunciation was not required. In the learning session the criterion 
used was the number of trials required to reach four out of five words 
correct with each of the two stimulus forms (words and pictures). This 
criterion was chosen as it appeared to be a stable and sensitive learn- 
ing index. 


Results 


Learning was significantly more rapid with the pictorial than with 
the written stimuli, the mean nurober of trials to reach criterion being 
9.93 with the pictures and 12.43 with the words. Of the 82 subjects, 55 
first reached criterion performance with the pairs in which pictures 
formed the stimulus items, 25 first reached criterion with the word items, 


TABLE 1 


MEAN NUMBER OF TRIALS TO CRITERION AND SIGNIFICANCE OF 
DIFFERENCES BETWEEN PICTORIAL AND WORD STIMULUS ITEMS 


Pictorial Stimulus Item Word Stimulus Item 


Subjects Mean SD Mean SD p} 
Age of class (grade) 
Nine years 10.05 5.07 # PIRSO 6.92 05 
Ten years LOSS 4.32 14.95 6.68 .0O1 
Eleven years 9.00 6.60 10.55 pita 05 
Sex 
Boys 9.36 ~ 3.86 13.16 6.91 001 
Girls 10.50 2.91 11.70 6.36 205 
Sex within Age 
(by grade) 
Boys age nine 9.20 4.21 12.00 8.63 .OO1 
Girls age nine 10.90 5.85 11.10 5.06 Ts 
Boys age ten 11.30 4.25 15.80 6471 .0O1 
Girls age ten 10.20 4.50 14.10 6.90 .OO1 
Boys age eleven 7.60 7.64 11.20 4.61 .0O1 
Girls age eleven 10.40 Dol 9.90 6.85 nS. 


1 Significance of difference using Duncan’s Multiple Range Test. 


and 2 children reached the learning criterion with both cue forms on 
the same trial. Randomly selected female subjects were discarded to 
leave 10 boys and 10 girls in each of the 3 ages (grades) and the data 
were analysed using a three way analysis of variance, with repeated 
measures on the stimulus item form variable (i.e., word or pictures). 
The difference between picture and word items in mean trials to reach 
the learning criterion by all children was significant (for form of items 
F = 29.43, df =1/54, p<.001), and there were significant differences 
in learning according to whether pictures or words formed the stimulus 
items for most of the grade and sex subgroups (see Table I). Neither 
of the other independent variables significantly affected the number of 
trials to reach criterion (for Age, F = 1.97, df = 2/54; for Sex, F = 1.00, 
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df = 1/54). However, there were significant interactions between form of 
stimulus item and each of the other variables (for Item Form X Age, 
F = 13.95, df = 2/54, p < .001; Item Form X Sex, F = 29.66, df = 1/54, 
p<.001; Item Form X Age X Sex, F = 5.88, df = 2/54, p «.01). No 
consistent simple trends were apparent, but as Table 1 shows there 
was a greater difference between words and pictures in trials to reach 
criterion among the 10-year old children than among the children of 
9 and 11 years, and within each age the difference between word and 
picture forms was greater for boys than for girls. The results were further 
analysed using a two way analysis for all 92 subjects, with form of 
stimulus item and age as the only independent variables. Again, the F 
for stimulus item form was significant, but that for age level was not. 


In the long-term retention test mean recall was greater for items 
learned with the picture cues than for items learned with words (4.03 
items out of 5, versus 3.47 items out of 5) but the difference was not 
significant at the .05 level. Of the 55 subjects who reached criterion in 
the learning session with the picture cue first, 35 recalled more 
pictorially-cued than word-cued items in the retention test, 15 recalled 
an equal number of words with each type of item, and five recalled 
more items with the word stimulus. Even among the 25 children who 
in the original learning session reached learning criterion first with the 
pairs in which words formed the stimulus items, only nine recalled more 
items paired with word stimuli than with picture stimuli in the test 
of long-term retention. 


Discussion 


The consistently superior learning performance with pictorial than 
with written stimulus items suggests that the form of the native language 
item is an important variable in foreign-language concrete vocabulary 
learning. This result shows that children in ages between nine and eleven 
years do not conform to Deno’s finding that using words of pictures 
makes little difference to adult learning of dissimilar vocabulary items. 
Precisely why children should differ from adults in this way is not clear, 
and research evidence is sparse (see Goulet, 1968), but it is likely that 
greater dependence upon verbal mediation in adults than in children 
may be a contributing factor (Davis, 1966). Note that the present finding 
applies only to the acquisition of oral skills. Other factors are clearly 
important when competence in the written language is required. 

As Deno (1968) observes, a problem with the use of pictures for 
learning the referents of foreign words is that the meaning evoked by 
a picture may not be the same as that intended. The fact that pictures 
have been found to interfere with children’s learning to read in their 
native language (Samuels, 1970) may be partly attributable to this. It 
is also conceivable that learning may be restricted to the particular 
images used in the task. However, in the case of children the former 
danger is not entirely absent when words are used, and there may be 
compensating advantages for picture items in the possibility that 
pictorial cues might help the learner gain independence from native 
language mediation processes. 
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In conclusion, pictures can be more effective than words for children 
who are learning to acquire oral competence in the vocabulary of a 
novel language (Spanish). The implications for the teacher are clear. 
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Self-Ideal Congruence in Five 
Occupational Groups 


A review of the research literature indicated that self and ideal-self (S-I) con- 
gruence variables have been related to measures of self acceptance, 
adjustment, flexibility, and performance. Normative data on the interpersonal 
checklist (ICL) was obtained from 584 subjects in five functionally dif- 
ferent occupational groups: counsellors and teachers-in-training, priests, 
high school students, and army officer cadets. Significant differences in 
congruence between “self” and “ideal-self’ were found upon group com- 
parison. Implications for S-I congruence, personality, and vocational research 
are discussed. Normative data for ICL Self and Ideal-Self Concepts are 
available from the authors. 


The self concept (S), which consists of the perceptions an individual 
has of himself, and the ideal-self concept (I), which contains personal 
aspirations, have been viewed as important referents of human behavior 
(Combs and Snygg, 1961; Lecky, 1945; Horney, 1942; Rogers, 1959; 
Wylie, 1961). The degree to which perceptions of self and ideal-self are 
in agreement with one another (as reflected by an S-I discrepancy or 
correlation) has been traditionally referred to as self-ideal (S-I) con- 
gruence (or discrepancy). 

The meaning and importance of S-I congruence as a_ personality 
variable have been a subject for popular debate for almost two decades. 
In simplest terms high S-I congruence has been equated with self 
acceptance. In addition, a number of studies have suggested that a 
linear relationship exists between S-I congruence and adjustment. Rogers 
(1951) and Butler and Haigh (1954) found that S-I congruence increased 
during psychotherapy and such changes were accompanied by improved 
adjustment. Turner and Vanderlippe (1958) found that college students 
with high S-I congruence participated more in extra curricular activities, 
attained higher scholastic averages, received higher sociometric ratings and 
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appeared better adjusted on the Guilford-Zimmerman Temperament Sur- 
vey, than students with low S-I congruence. Further support for a linear 
relationship between S-I congruence and adjustment has been reported 
by Chase (1957), Chordorkoff (1954), Crandall and Bellugi (1953), East- 
man (1958), Friedman (1957) and Smith (1958). 

In contrast, Block and Thomas (1955) have expressed reservations 
about viewing a person whose self concept and ideal-self concept close- 
ly match as being well-adjusted. They have presented findings which sug- 
gest that individuals with high S-I congruence have rigid and overly inte- 
grated personality structures. Furthermore, they have suggested that the 
relationship between S-I congruence and adjustment is curvilinear (invert- 
ed U). Cole et. al. (1967) and Zuckerman and Monashkin (1957) have 
also found that moderate S-I congruence is more indicative of adjustment. 


Since adjustment and performance may be logically linked, S-I congru- 
ence has been investigated as a variable for predicting performance in 
various settings. As was the case with S-I congruence and adjustment, a 
certain amount of disagreement exists in drawing inferences about per- 
formance from the magnitude of a given S-I discrepancy. For instance, 
Waterland (1965) found no significant relationship between S-I congruence 
and counsellor performance. Vellutino (1964) concluded that the relation- 
ship between S-I congruence and the ability to make a “good” decision is 
curvilinear. Hay (1966) observed that engineering managers with high 
S-I congruence were more effective than managers with low S-I congru- 
ence. Park and Eberlein (1969) found that counsellor trainees with mo- 
derate S-I congruence were more flexible than counsellor trainees with 
either high or low S-I congruence.- As well, Eberlein and Park (1971) 
have reported a significant curvilinear relationship (inverted U) between 
S-I congruence and performance of counsellor trainees as rated by their 
supervisors. Contradicting Turner and Vanderlippe’s (1958) findings, 
Matheson (1969) found that high school students with low S-I congruence 
were higher achievers than students with high S-I congruence. 


Problem 


It seems apparent that despite some lack of agreement about mean- 
ing, the concept of S-I congruence has proven to be a fruitful personality 
variable and thus merits further systematic investigation. It is also ap- 
parent, however, that most of the studies which have concentrated on 
concepts of self have utilized different instruments and different equa- 
tions for generating scores which reflect congruence. The result of these 
divergent approaches to the study of S-I congruence has created a situ- 
ation wherein the individual researcher is left puzzled about how repre- 
sentative are the congruences in his particular sample. There also appears 
to be a dearth of information about what facts, if any, are concealed 
by global S-I congruence scores which have been calculated from a large 
number of personality traits. That is to say, it is quite possible that two 
individuals (or groups) can have equal S-I congruence scores while hav- 
ing different scores on the dimensions which comprise self and _ ideal- 
self concepts. The present study was undertaken to obtain normative S-I 
congruence data for the Interpersonal Check List (ICL) and to examine 
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differences in self concept, ideal-self concept, and S-I congruence which 
might exist between a variety of groups with different functional roles. 


Meth 
Sample 0 


The sample in the present study consisted of the following five groups: 

(1) Group one consisted of 121 counsellor trainees who were regis- 
tered in The University of Alberta Educational Psychology counselling 

' practicum between 1967 and 1969. Most of the trainees were in the first 
year of the Masters Degree program in Educational Psychology or in a 
related graduate diploma program. This group included 36 females and 
85 male trainees. 

(2) Group two consisted of 3807 teachers-in-training who were re- 
gistered in a senior undergraduate University of Alberta Educational 
Psychology course concerned with classroom social dynamics. This group 
was mainly composed of students whose teaching experience was limited 
to one practicum course; a significant minority, however, were teachers 
who were returning to university to upgrade their qualifications. The 
teacher group contained 185 females and 122 males. ICL data was col- 
lected from four sections of the course offered in 1968 and 1969. 

(3) Group three consisted of 25 Alberta priests who were registered 
in a three day pastoral counselling seminar in May, 1968. 

(4) Group four consisted of 67 Grade X students from Summerside, 
Prince Edward Island, in May, 1968. The students were volunteers and 
represented 67 per cent of the grade X population. This part of the 
sample included 41 females and 26 males. 

(5) Group five consisted of 64 male Canadian Army Officer cadets 
who were attending a leadership training program in Manitoba in the 
summer of 1969. The cadets were students registered in degree programs 
at various Canadian universities. (Bain, 1970) 


Self Concept and Ideal-Self Concept Scores 


The Interpersonal Check List (ICL) (Leary, 1957) was used to obtain 
measures of self concept and ideal-self concept. Each group of trainees 
was first given a “set”? to respond to each of the 134 ICL adjectives or 
phrases for the purpose of reporting self concept: “This is how I see 
myself.” They were then requested to re-do the instrument using a second 
“set” to measure their ideal-self concept: “This is the way I would like 
to be.”’ As each ICL item has been assigned an intensity weight, S and I 
scores were obtained on 16 dimensions by summing intensities for items 
checked “true” for each trainee. ICL octant scores were obtained by 
combining adjacent 16’s in accordance with Leary’s theory (1957). Further 
scores on four dimensions were obtained from a factor analysis of res- 
ponses made by all subjects in this study (Eberlein, 1969). To determine 
S-I congruence a vector analysis technique measured the distance be- 
tween the 16, 8, and 4S dimensions and the similar I dimensions. ! 


Since the priests and army cadets included only male Ss there was 
a question as to whether or not their S-I discrepancy scores would be 


|The distances between two vectors with n-components in n-dimensional Euclidean space can be 
determined by vector analysis techniques. In the present study S-I discrepancies were calculated with the 
. - 1 al . Vf, 
following formula: [STj-a YX (So —le lal be 
i=1 ; ; : . : pape 
S and I are vectors of self and ideal-self concept scores respectively. High S-I discrepancies are associated 


with low S-I congruence and low S-I discrepancies are associated with high 5-1 congruences. 
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comparable to S-I discrepancy scores obtained from the other groups 
containing both male and female Ss; t-tests were therefore used to de- 
termine whether or not significant differences existed between the dis- 
crepancy scores of males and females within each of the other three 
groups. As only small and non-significant differences were observed, Ss’ 
scores were not separated according to sex for further analyses on the 
congruence data. 

In order to determine whether or not the overall differences between 
groups were significant a one way analysis of variance procedure was 
utilized to compare means. Table 1 reports both the significant F ratio 
obtained and the results of a Scheffe analysis, along with mean S-I 
discrepancies of each of the five groups. 


TABLE 1 
SELF-IDEAL DISCREPANCY SCORES FOR FIVE SAMPLE GROUPS! 


Group N Mean SD 
Counsellors 
in training 121 16.80 7.09 
Teachers in 
training 307 19.07 6.52 
Priests 25 2oA7 7.00 
High School 
Students 67 19.94 5.45 
Army Officer 
Cadets 64 16.60 6.04 
Total all 
groups 584 18.56 6.62 


‘Analysis of Variance yielded F = 6.84, p< .001; Scheffe comparison yielded 
significance at .05 level on following: (1) counsellors compared with teachers, 
priests, and high school students, (2) priests compared with army officer cadets. 


Results and Discussion 


The magnitude of the S-I discrepancy is inversely related to congru- 
ence. From Table 1, one finds the priest group obtained the highest mean 
S-I discrepancy scores and therefore they were least congruent. On the 
other hand, counsellor trainees and army officer cadets were the most 
congruent, both differing significantly from the priests. In addition, the 
counsellor trainee group was significantly more congruent than teacher 
trainees and high school students. 

While it has been traditional to interpret findings on the basis of 
“global” congruence scores, the authors felt that subtle differences 
between groups might be made clearer by examining group S-I discrep- 
ancies on individual dimensions. For each group the S-I discrepancy for 
each of the sixteen dimensions was calculated. These were ranked in 
terms of their contribution to the global S-I discrepancy score (Table 2), 
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The trait for which the greatest S-I discrepancy was observed was given 
rank “1”; the trait which contributed least to global discrepancy received 
rank “16”. Part A of the table reflects traits where self scores were 
higher than the ideal; Part B reflects ideal scores higher than the way 
the group saw themselves at present. 

While the present paper is primarily concerned with S-I congruence 
as a personality variable, the collection of normative data on each of 
the ICL 16, 8 and 4 dimensions was of interest to the investigators and 
may be obtained by writing the senior author. 


Two questions about these results seem pertinent for discussion: 


1. Are these results supportive of previous research on S-I congru- 
ence theory? 


2. Do these results have implications for the relationship between 
personality and vocational choice? 


As was mentioned earlier, high S-I congruence has been traditionally 
treated as being synonymous with self-acceptance, while low S-I con- 
gruence has been linked with self-rejection and self-deprecation. Simi- 
larly, it has been generally accepted that low S-I congruence is associa- 
ted with difficulties in adjustment, while the meaning of high S-I con- 
gruence is less clear. When applied to the groups in the present study 
and using the linear model, these findings suggest that the army officer 
cadets and counsellor trainees are more confident, less self-deprecating, 
and probably less in conflict about personal matters than the priests. 


Independent support for the above interpretation is noted in the 
following remarks by Siegelman and Peck (1960) about army officers 
and ministers: 


The officer appears to have confidence in his ability to achieve his 
goals, and he looks for the most favourable environmental conditions 
to support his efforts. Perhaps inner security and stability permit and 
facilitate energy investment in external issues and an adequate person- 
ally acceptable job of coping with his problems. (p. 321) 
The minister is more “introverted” than the military officer... . Inse- 
curity and anxiety about personal qualities are indicated and there is a 
searching desire to critically scrutinize his abilities. One possible reason 
’ for this emphasis on personal short-comings might be a need for atten- 
tion, acceptance, and approval which he unconsciously attempts to 
elicit by his honest, self-derogatory remarks. (p. 219) 
To a lesser extent similar inferences might be extended to describe the 
counsellor, teacher, and student groups with respect to where they fall 
on the S-I congruence continuum. 


The student group represents a population which is less committed 
to a particular vocation. Previous research by Bloom (1961) has indicated 
that S-I congruence increases with age (until age 59, after which it 
begins to decrease). Since adolescents typically are viewed as experienc- 
ing anxiety over interpersonal, social and sexual problems it should not 
be surprising that the high school student group obtained the second 
highest mean S-I discrepancy scores. 

The relatively low S-I discrepancies of the counsellor group could be 
a favourable sign. Byrne (1966) has suggested that individuals with low 
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S-I discrepancies favour avoidance-denial defensive modes, while 
individuals with high S-I discrepancies are more likely to display in- 
tellectualization and sensitization defensive styles. Bales (1970), in his 
recent discussion of personality types, has suggested that it is character- 
istic of individuals given to avoidance-denial defense sets to possess the 
power of being able to alleviate anxieties in others. To have such a 
talent would seem desirable in many counselling situations. On the other 
hand, an extreme usage of avoidance-denial defenses could lead to lack 
of flexibility in personality structure (Block and Thomas, 1955) which 
would handicap counselling process development. This raises the possi- 
bility that counsellor trainees may be, in general, overly integrated 
individuals who seek security in a rather non-threatening environment 
away from classroom frustrations or business pressures by working with 
less secure individuals than themselves. The authors suspect, however, 
that a larger sampling of vocational populations would uncover a variety 
of occupations which attract individuals with more rigid personalities 
and hence lower S-I discrepancies. 


It is important to note the similar ranking of characteristics which 
contributed to the global S-I discrepancies of all groups. By examining 
Table 2 one can observe that all groups expressed a desire to be less 
self-effacing, less distrustful, and rebellious while being more conven- 
tional and responsible. Priests were slightly different from other groups 
in the sense that they had more of most traits than they deemed de- 
sirable. In particular, they expressed a need to be less narcissistic whereas 
all other groups felt that it would be ideal to have more of that trait. 
While the similarities noted may be an indication of the influence of a 
social-desirability factor, these results suggest the possibility that diverse 
groups of individuals are basically similar with regards to the traits 
about which they feel discrepant. This thesis could be examined by a 
closer analysis of trait discrepancies for a larger number of groups. 


The differences observed in S-I congruence for the four vocational 
groups offer support to those writers who have suggested that there are 
conceptual similarities between vocational interest and _ personality 
(Seiss and Jackson, 1970) or who believe that vocational choice is the 
implementation of self concept and self-regard (Becker and Strauss, 1956; 
Thompson, 1960). It would be relevant to replicate the present study in a 
different cultural setting paying closer attention to pre and post - training 
concepts of self, age, socio-economic background and so forth. For ex- 
ample, it might be interesting to examine relationships between adjust- 
ment measures on some personality inventory, self-ideal congruence, 
and vocational choice. In this way some clarification about whether 
priests’ high S-I discrepancies were related to their idiosyncratic concern 
with the imperfection of man. Similarly, such research might reveal 
whether there is truth in the assertion that vocational choices and in- 
terests are “part and parcel of the individual’s total striving for adjust- 
ment and grow out of needs arising in his personality development” 
(Darley and Hagenah, 1955, p. 263). 
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Success of Mature Age Students 
In University Studies 


When “mature” students who do not have the regular admissions re- 
quirements to University are permitted to enroll, how will their perfor- 
ance on a test of general educational achievement and their grade point 
average compare with regularly admitted students? The data presented 
in this report suggests that if “mature” students concentrate their studies 
in the Arts and Humanities they may be quite successful. While the 
“mature” students as a group had some of the poorest results when com- 
pared with four other groups of students on the College Qualification 
Test, they had some of the best results when compared on grade point 
average. 


When the University of Lethbridge began its first academic year in 
September, 1967, it had no results or norms on standardized tests to 
indicate the level of performance of freshmen students who were being 
admitted to university. Students were admitted on the basis of their 
performance on an external senior matriculation examination written at 
the conclusion of high school. This was the custom in most provinces 
in Canada. 

A matter of concern to university officials was the need to have more 
suitable criteria from which to admit ‘mature’ students—a_ special 
admission category at the University of Lethbridge. A “mature” student 
for admission purposes was defined as a student 21 years of age or over, 
who lacked the regular senior matriculation requirements and in some 
instances, dropped out of school before reaching grade twelve. Because 
of the exigencies of the situation, (first year of operation of an “instant” 
university) twenty-three mature students were admitted in September, 
1967, on the basis of an interview with the investigator, their previous 
school record, their work experience, and a recommendation from their 
employer, principals or teachers attesting to their ability to profit from 
university work. 


It was anticipated that as the mature student plan became more 
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widely known, an ever increasing number of people would make applica- 
tion to be admitted under this policy. This was confirmed in the Fall 
of 1968 when approximately sixty “mature” students were admitted. 
(In 1969-70, there were approximately 200 “mature” students enrolled at 
the University of Lethbridge.) A more objective evaluation of students 
was needed in order to be able to make more predictive correlations 
with grade point averages and do a more effective job of screening 
applicants. Because of their lack of recent background in the natural and 
physical sciences, most of the “mature” students tended to concentrate 
on Arts courses. 


Further, it was extremely desirable to compare the general academic 
performance level of the mature student upon admittance with that of 
the typical freshman who had just graduated from high school. It was 
considered even more important, however, to follow the “mature” stu- 
dents and compare their actual performance (GPA) with those of 
other freshmen. 


Douglas (1931) and Travers (1949) had both written about the lack 
of relationship between the pattern of high school subjects and success 
in university, with the requirements for specific high school credits and 
courses barring aS many superior as inferior students from university. 
Cook (1961, 1962) compared the college performance in two consecu- 
tive years at the University of Indiana of 1400 freshmen and 2,425 
freshmen who had college preparatory and non-college preparatory work. 
He concluded: “It did not make a great deal of difference whether a 
student took a college preparatory course (with more mathematics, lan- 
guage and science) or a non-college preparatory course as far as grades 
earned in college were concerned”. 


It was the purpose of this study, then, to compare the performance 
of “mature” students who did not have the usual pattern of academic 
subjects for admittance to university with several groups of regularly 
admitted freshmen on the College Qualification Test (CQT) and on the 
Fall, Spring, and Accumulative grade point average (GPA). 


Procedure 


Since the freshmen who were entering university direct from high 
school had varying degrees of proficiency on an external senior matricu- 
lation examination, particularly as to the number of subjects written and 
passed, it was decided to categorize the students accordingly. 

Consequently, as shown in each of the tables where all the groups 
are compared, the following groups were formed: 

Group I was comprised of students who had five subjects on senior 
matriculation exams with an average of 60% or better but failed the 
sixth subject. 

Group II was comprised of students who completed five subjects on 
the senior matriculation with an average of 60%+ but had passed the 
sixth (50% to 59%). 


Group III was comprised of students who had six subjects with an average 
of 60%+ and wrote 6 to 8 exams to do so. 
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Group IV was comprised of students who had written five subjects with 
an average of 60%+ but had to write 9 or more examinations to do so. 
The average number of exams written by this group was 11, with one 
student writing 18 exams to obtain an average of 60%+ in five subjects. 
This group was thought of as the “persisters”. The investigator was 
particularly concerned with how this group compared with the other 
groups. 

Group V was comprised of ‘‘mature students” (non-matriculants) who 
were admitted on the basis mentioned earlier. It should be pointed out 
that the age range for this group was from 21 to 53 years of age. 
The mean age was 30 years. 


Group VI was the total group—all five groups together. 


Sample 


The sample consisted of 107 first year students subdivided into the 
five groups mentioned. Originally, a random sample of 25 in each of 
the first four groups was obtained from the. Registrar’s Office which 
together with the 23 in the mature student group would have made a 
total of 123 students. Since participation in this project was purely 
voluntary, not all of the students wrote the CQT, with the result that 
the total N was 107 students, instead of the possible 123. 


Test Used 


The College Qualification Test was used in this study because of the 
flexibility it gave in being able to be administered at the University’s 
convenience and not on the date specified by the publisher. This is par- 
ticularly important in a sparsely populated area like southern Alberta. 
When a student travels a considerable distance to inquire about a ma- 
ture student admission, it is possible for him to take the CQT during 
that visit and not have to make a second journey to write the test. 


The College Qualification Test is published by the Psychological 
Corporation, New York; it was normed in 1956 on 22,000 freshmen 
college students. It is an objective multiple choice type test. The several 
sub-tests include: (1) Verbal which takes 15 minutes and consists pri- 
marily of antonyms and synonyms, (2) N or Mathematics which takes 
35 minutes and includes general arithmetic and elementary algebra, and 
(3) Information which takes 30 minutes and can be sub-divided into 
science and social studies. The total test time, then, is 80 minutes and 
the total possible test score 200, sub-divided as follows: Verbal 75, Math 
50, Information 75 with Social Studies being 37 and Science 38. 


Administering the Test 

The students participating in this study were asked to report to the 
University on a Saturday early in the Fall semester specifically to write 
the CQT. Approximately, two-thirds of the sample reported at the place 
and time requested. The students in the remaining one-third of the 
sample were contacted individually and tested at the Counselling 
Center individually or in small groups. 
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Analysis of Data 


To determine if there were any differences among the five groups, 
a one way analysis of variance was computed for each CQT sub-test, 
total test and grade point averages for each semester and the combined 
semesters. When an F test in a one way analysis of variance indicated 
a significant difference, a Duncan multiple range test was computed to 
determine which pairs of means were significantly different. 


Results 


Because of the detailed nature of analysis of variance tables, only 
summary tables are presented here (more complete tables may be ob- 
tained from the author). 

For convenience and ease of comparison, Table 1 presents a summary 
of the CQT sub-tests and total test (aggregate of sub-tests) means and 
standard deviations for the five groups and total groups. The “mature” 
students had the lowest mean score of the five groups on all the sub- 
tests except the Verbal in which they received the highest mean. Also, 
they received the lowest mean of the five groups on the CQT total score. 

The F-values reported in Table 2 were highly significant (p < .01) in 
the area of Verbal, Mathematics, Science and the Total Test. The groups 
which showed significant differences in these areas are shown in the 
last column of Table 1, with the first mentioned group of pairs having 
the smallest difference between means, but still having a significant 
difference. It is interesting to note that the “mature” students were 
significantly different from group four in the Verbal sub-test. 


TABLE 2 


ANALYSIS OF VARIANCE RESULTS. FOR THE FIVE GROUPS ON THE CQT 
SUBTESTS AND TOTAL TEST 


Groups With 
Sumsof Mean Significant 
Area df Squares Square F Differences! 
Verbal 4 1897.15 474.29 At ON So Ty: 
Mathematics 4 2895.60 723,908 20:79%* TT TV) Lake, Ts 
Vi IL & VielV. & TVs 
LIV&V,I&V 
Information 4 718.98 179.74 3.45* II&IV,NI&lwvl&v 
Science 4 ZOU, 20) 62.56 BBO. Ui el LLL Ouey, 
Social Studies 4 123.83 30.96 1.63ns 
Total Test 4 6590.13 1647.53 &.30** TIT & I til & IV, Tiba V 


1The first group mentioned in each pair of groups has the largest mean score; 
the smallest mean difference is between pairs of groups mentioned first, e.g., last 
pair of groups mentioned has the largest mean differences. 


ye Woe p <.U01, 


The F-value in the area of Information was significant (p <.05) with 
group three being significantly different from groups one, five, and four. 
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Group three, the group that passed six senior matriculation subjects— 
more than any other group—is, of course, the group with the consistently 
superior performance on the CQT as shown by the number of times it 
is cited in the last column of Table 1. 

The area of Social Studies does not show any significant F-value be- 
tween the groups. 

In Table 3, the Fall, Spring and Accumulative GPA are summarized | 
for the five groups and total group, with the “mature” students achiev- 
ing the highest Fall GPA, the second highest Spring GPA and the highest 
Accumulative GPA. 

TABLE 3 


MEANS AND STANDARD DEVIATIONS OF THE FIVE GROUPS OF FRESHMEN 
AND TOTAL GROUP ON FALL, SPRING AND ACCUMULATIVE G.P.A. 


Fall GPA Spring GPA Accumulative GPA 
N Mean SD Mean SD Mean SD 


Group | 16 1.91, 08 1.89 .0O 1.90 50 
Group II 16 215 .86 2.26 15 2.18 .76 
Group III 21 2.40 el 2.38 73 2.37 .63 
Group IV 21 1.95 .67 2.03 .68 1.99 .67 
Group V 14 2.54 84 22 1.14 247 89 
Group VI 

(Total) 88 2.18 eerie) 2.18 78 218 ata’ 


The F-value presented in Table 4 for the five groups on the Accumu- 
lative GPA means was significant (p<.05). As the last column of the 
table shows, group five, the “mature” students, was significantly dif- 
ferent from groups one and four, but not from groups two and three. 


Discussion 


This preliminary or pilot study done with regularly admitted and 
Specially admitted “mature” students at the University of Lethbridge 
during its first year of operation, 1967-68, reveals some interesting 
results. 

Analysis of variance summaries on all of the CQT sub-tests and 
total test showed that there were some significant differences among 
the groups on some of the sub-tests. There was also significant dif- 
ferences among some of the groups on CQT total test (an aggregate 
of all the sub-tests). 

The data showed in Table 1 that when the ‘mature’ students were 
compared on the CQT with the other four groups, regularly admitted 
freshmen obtained the lowest mean score on four of the five CQT sub-tests; 
the sub-test on which they attained the highest score was the Verbal. 
On the CQT total score, the “mature” students had the lowest mean 
score. Nevertheless, these same students had the highest Accumulative 
GPA of the five groups and were significantly different from groups one 
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TABLE 4 


ANALYSIS OF VARIANCE RESULTS FOR THE FIVE GROUPS 
ON THE ACCUMULATIVE GPA MEANS 1967-68 


Groups 
With 
Sum of Mean Significant 
Source df Squares Square Differences! 
Between Groups 4 3.94 0.99 2.00" V&IV, 
V&I 


Within Groups 83 39.82 0.48 


'The first group mentioned in each pair of groups has the largest mean score; the 
smallest mean difference is between pairs of groups mentioned first, eg. last pair 
of groups mentioned has the largest mean differences. 


*p<.05. 


and four (Table 4). It would seem that the “mature” students’ higher 
GPA was due to their superior maturity and motivation as well as their 
selection of non science subjects. 


While the sample is too small to make broad generalizations, one 
cannot help speculating as to whether the CQT or for that matter, 
any other general achievement test can adequately predict the success 
of “mature” students with university work, positively, if they enroll in 
the Arts courses and do not select subjects in science, as nearly all the 
“mature” students in this study did. It would seem that maturity and 
motivation compensate for their lack of past formal educational ex- 
perience, as far as the study of Arts and Humanities is concerned. 


The success of “mature” students at the University of Lethbridge 
during 1967-68 would tend to support the views of Douglas (1931), Travers 
(1949) and Cook (1961, 1962). It seems that, given a minimum native 
ability or intelligence, the crucial factor for success at university is mo- 
tivation and not necessarily prior experience in certain subjects, parti- 
cularly in the Arts and Humanities courses. Because motivation seems 
to play such a vital role in the success of the “mature” students, a 
test of motivation was given to the students participating in another 
study conducted during 1968-69. It will be interesting to see if this more 
recent study which is currently being analyzed and which includes the 
Motivational Analysis Test contributes to our understanding of the 
success of “mature” students. 


Halal 


S. Perkins 
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Cognitive Perception and the Conceptual 
Foundations of Research 
In Educational History 


This article examines some of the principles of psychological set and 
perception, and their application to the educational historian’s under- 
standing of history or historical reality. The traditional distinction be- 
tween what actually happened in history and what is recorded or inter- 
preted is examined in the light of these principles. The educational his- 
torian runs the risk of enacting the “self-fulfilling prophecy” in conduc- 
ting his research if he operates according to the traditional distinction 
between “history as actuality” and “history as _ interpretation.” The 
study suggests that the conceptual foundations of historical inquiry 
and their psychological implications require further research. 


Leopold von Ranke, the father of scientific history, once remarked 
that the “supreme law” of historical inquiry is “the strict presentation 
of facts, contingent and unattractive though they may be (1956, p. 57).” 
In recent times, Ranke’s dictum has prompted educational historians to 
direct their attention to the problem of objectivity (Bailyn, 1960; Butts, 
1967), and has necessitated a re-examination of some of the traditional 
assumptions relating to historical evidence and interpretation. The 
question eventually comes round to the nature of history or historical 
reality and how an understanding of that reality is dependent upon the 
historian’s psychological perception. 

Set, Perception and Historical Reality 

There is evidence to suggest that one’s cognitive perception of any 
situation is, in part, shaped by what psychologists term set or Einstellung 
(Bruner and Postman, 1948; Forgus, 1966; Hollander, 1967; Stewin, 1969). 
Set, which might be regarded as a state of readiness, predisposes the 
subject to adopt a particular mental outlook (English and English, 1958). 
Such an outlook entails perception which, in turn, can generally be 
defined as “the process by which an organism receives or extracts 
information about the environment (Forgus, 1966, p. 2).” Taken together, 
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set and perception are integral to the historian’s personality (Stewin, 1969) 
and, hence, affect his view of historical reality. Fritz Medicus writes: 
A given event may be treated by one historian as of the greatest impor- 
tance, and by another as quite incidental for the knowledge of a certain 
group of facts: each of the two historians is facing it with the experience 
of his own personality...he cannot understand it except in relation to 

what gives concreteness to his life (1963, p. 141). 
Compounded of his needs, values, hopes, past experience and culture, 
the historian’s personality reflects “all those items of his past history 
which have gone into making him what he is (Bruner and Postman, 
1948, p. 84).” 


In its broadest sense, perception aims at the “construction of a stable 
and meaningful environment (Postman and Bruner, 1948, p. 322),” the 
attainment of which entails a process of categorization (Bruner and Post- 
man, 1948; Bruner, Goodnow and Austin, 1956). This procedure serves to 
organize and direct the historian’s interpretation of reality. Research 
indicates that already existing categories are usually employed to 
determine new experience, thereby tending to make the use of such 
categories inflexible and somewhat permanent (Youtz, 1948; Postman 
and Bruner, 1948). It is not unusual, therefore, to find that the educa- 
tional historian readily assumes the standardized categories established 
by his profession. Charles Beard delimits history in terms of these 
categories when he writes: 

What, then, is this manifestation of omniscience called history? It is, 

as Croce says, contemporary thought about the past. History as actu- 

ality includes, to be sure, all that has been done, said, felt, and thought 

by human beings on this planet since humanity began its long career. 

History as record embraces the monuments, documents and symbols 

which provide such knowledge as we have or can find respecting past 

actuality (1934, p. 219). 

Thus historical reality represents both a past existence, apart from any 
activity in which the historian may be engaged, and the subsequent 
interpretation of that existence. 


A fundamental principle of perception states that individuals “tend 
to. perceive experiences in the way in which they expect to perceive 
them (Hollander, 1967, p. 96). Known as perceptual constancy, this 
phenomenon implies that the conceptual structure imposed upon an 
experience follows from preconceived notions as to how that experience 
ought to be interpreted. If this is the case, it would not be unexpected 
for the researcher to adopt a priori the twofold approach towards his- 
torical reality. Whether an event under study, therefore, centers on the 
social forces shaping the growth of the medieval university or the 
theoretical basis underlying Pierre Abelard’s teaching method, the 
historian perceives this event in terms of what actually happened and 
what subsequently was recorded and interpreted. 


Related to this psychological orientation are cognitive principles of 
wholeness and closure. Wholeness, the tendency to see stimuli as fit- 
ting together, and closure, the adding in of absent elements so as to 
achieve wholeness (Hollander, 1967, p. 96), predispose the individual 
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to consider history as actuality to be interdependent with and comple- 
mentary to history as interpretation. In effect, these principles reinforce 
cognitive perception along lines of the dualistic framework. Educational 
historians generally assume a connection, for example, between Rous- 
seau’s recorded ideas on education and a pre-existing state of affairs 
or “stratum of reality” of which those ideas were originally a_ part. 
In this case, the historian, viewing the association between “actuality” 
and “interpretation” as “proximal or sequential” (Hollander, 1967, p. 99), 
may impute a type of causality to this association where none may exist. 
As Anthony Quinton concludes, “the relations that obtain within the 
body of our knowledge do not also connect it with what is outside 
(1967, p. 84).” 


Implications 


Although it might be argued that a dualistic approach to the under- 
standing of educational history has proved workable in everyday research, 
it must be noted that the acceptance of such a conceptual foundation may 
harbour difficulties for which the historian is not fully prepared. In 
assuming that history is in part actuality, the historian knowingly or 
otherwise supposes an imaginary model or standard of perfection which 
functions as a criterion for the completeness of his inquiry. Such a model, 
however, can only be used if it can be made explicit. One cannot realis- 
tically pursue a model which is undefinable and appears to be beyond 
means of empirical verification. Again, how does one meaningfully 
describe or explain something which cannot be cognitively perceived? 


These objections might be answered by suggesting that the past as 
actuality becomes what the historian presumes it was. If this is the case, 
however, the past as actuality cannot be differentiated from the past 
as interpretation and historical inquiry might become nothing other 
than an expectation, the supposed attainment of which could well lead 
to a classical instance of the “self-fulfilling prophecy.’ How, then, does 
one decide which interpretation of an educational event is the most 
acceptable? Further, what is the historian’s alternative to his present 
conceptual foundation? In answering these questions, one should not 
be unaware of Napoleon’s charge that “History is but a fable, agreed 
upon.” 
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Component Curve Analysis of Student 
Performance on a Computer-Based 
Simulation Game! 


A review of the theoretical basis of component curve analysis, a multi- 
variate technique for examining learning data from a repeated measures 
design, is given. Variations in the method and unresolved issues such as 
rotation are discussed. The method is illustrated using data from stu- 
dent performance records on a computer-based simulation game. The 
results illustrate the potential value of the method for describing such a 
complex learning situation. 


The history of learning theory has largely been one of apparent con- 
tradiction. A large number of experiments have been performed under 
many different stimulus situations using many different samples in order 
to prove or disprove a particular theory that is currently in vogue or 
to make a choice between two prominent positions. In general it seems 
fair to conclude that under a certain set of conditions one theory has 
been shown to be the more desirable whereas under slightly different con- 
ditions (or often, even under ‘identical’ conditions) a different theory 
has become more tenable. The result has been a trend toward “micro- 
theory”, each theory being valid only for a very restricted domain of 
circumstances. The herculean task facing current researchers is_ to 
consolidate this ever increasing and expanding wealth of related mate- 
nial. 

A general feature of almost all educational research conducted 
prior to the last decade, and indeed, a large proportion of current re- 
search, has been the bivariate nature of the experiments. All physical 
variables are controlled by using a highly simplified situation and the 
tremendous complexity of individual differences is assumed controlled 
for by the process of randomization. The researcher is left with two 
variables and his task is to observe the relation between them. In more 


' Thanks are due to Dr. S. Hunka, Coordinator, Division of Educational Research Services, for advice in 
the preparation of this manuscript. 
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complex studies there may be more than two variables but they are 
usually assumed to be independent of each other and separate analyses 
are conducted for each set of variables. Cattell (1966) summarizes this 
state of affairs as follows: 

...a good deal of the fruitlessness of the immense labour spent in trying 

to arrive at firm and comprehensive laws of learning by bivariate re- 

search has been due to a great part of the relevant picture being 

blotted out from the experimenter’s calculations (p. 479). 

It is apparent that other approaches will be necessary in order to 
extricate ourselves from the virtually infinite number of hypotheses 
that can be validated by only looking at a small slice of the total pic- 
ture. Fortunately the advent of computers has brought methods of analy- 
sis within the researcher’s domain that have been impossible to carry 
out manually. For example, multivariate analyses—including factor 
analysis—are now possible whereas only a few years ago they would 
have had to be rejected because of the immense labour involved in 
doing the calculations. 

Within the context of learning theories, it often happens that the 
average learning curve for a group of subjects does not represent the 
learning curve for any single individual. For example, in ktudies that 
examine “insight” in a problem solving task, each subject’s learning 
curve will show a sharp increase at the point in time when he under- 
stands the problem. Yet because different subjects ‘‘see” the solution 
at different times, the average learning curve will show none of the 
sharp increases but rather a gradual rate of increase. This type of situa- 
tion justifies looking at other approaches for examining learning data, 
such as that of component curve analysis. 

It is the purpose of this paper to present a technique that is illustra- 
tive of a multivariate approach to learning theory. The applications of 
factor analytic methods to learning data was first investigated by Tucker 
in 1960. Initial results (Weitzman, 1959, 1963; Tucker, 1960; Duncanson, 
1964) have been encouraging and it appears that the method may make 
a useful contribution to the development of learning theory. 


The source of data used for this particular study consists of per- 
formance records of a group of students on a simulation game that 
was presented via an IBM 1500 instructional computer system. The 
primary purpose of this study was to examine the suitability of Tucker’s 
component curve analysis for analyzing data from a computer-assisted- 
instruction situation. 


Theory 
General 


The first step in the statistical analysis of a set of data is the specifica- 
tion of a theoretical model. This is true regardless of whether one is 
using analysis of variance, regression analysis, or factor analysis. The 
choice of a particular model is dependent upon relevant theory, previ- 
ous research, and practical considerations. Because of the complexity of 
the computations and because of a desire for a “‘simple” model, a linear 
model is often postulated. 
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A linear model as used in classical factor analysis is given by 
“y= ay Py taj Fo + ...+ ain Fai +t ajUji 
where: 
Z;, represents the standard score for person i on test j 
Ajm Yepresents the factor loading for test j} with common factor m 
F,,; represents the factor score on factor m for person i 
a; represents the factor loading for test j with unique factor j 
U; represents the factor score for person i with unique factor j. 


This model is commonly used when studying the abilities that charac- 
terize the behaviour of a group of subjects. Thus variables such as verbal 
ability, spatial ability, general reasoning ability, etc. are usually defined 
in terms of factors derived from an analysis of the correlation matrix 
of test items. A subject’s observed score is then represented as a 
weighted sum of these unique abilities. 

The algebraic expression may be expressed more compactly using 
matrix notations. 

nn =[A: a] [fiu] = Af+ au 


St Misan') an Pn where: 


n = number of tests 
N = number of subjects 
m = number of common factors 
Since the correlation matrix, R, is equal to ZZ'/N, 
we have R= MFF'M'/N = M$M', where $= FF'/N. 
Notice that $ is the correlation matrix between the factors. 


In the special case where the factors are orthogonal, $ = I and hence 
R = MM’. Thus an orthogonal solution consists of decomposing the cor- 
relation matrix into two matrices M and M' such that MM' = R. 

In most cases the investigator is interested, not in reproducing R 
exactly, but in estimating R by R using only m (m<n) common factors. 
In this case, we have: 


from which we have: 
R= AfPA'Y/N=A%A' where # = ff/N. 

Once again, a solution is orthogonal if ¥ = I, implying R = AA‘. 

It is of interest to note that there are an infinite number of matrices 
A such that R = AA". 

A more general approach, which need not be used with just a correla- 
tion matrix, has been provided by Eckart and Young (1936). They have 
developed a method for approximating, in a leas{ squares sense, any 
matrix X, such as a set of scores, by a matrix X obtained from any 
specified number of factors. 

The Eckart-Young analysis of the data matrix X is given by the equa- 
tion: 

nXN Fi mY a nGn NWn 
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where V is an orthogonal matrix (V' = V"!) 
W is an orthogonal matrix (W' = W-!) 
G contains the eigenvalues,4, in the diagonal elements of the 
upper left section and zeros elsewhere. 


This work forms the basis for analyzing the component curves. When 
the scores in the X matrix represent learning data, then the V matrix 
reflects a set of learning curves and the W matrix tells us something 
about the individual’s behaviour relative to these curves. 


Tucker’s Approach 


The matrix X, approximating the score matrix X, is formed by using 
the first k left principal vectors, (cols) in V, principal roots in G, and 
right principal vectors (rows) of W to form the matrices V;,, G,, Wx 
such that 

nXkn = aVk_ yOu, ,Wen (1) 
Tucker defines the matrices, 

B*,, and Y*, as follows: 

Bt, =N-*% V,G, (2) 

Y*,=N% Wx (3) 
where N” is a scaling factor to ensure that the mean square of each 
row of Y*, is unity. 

Thus 

Xi Bay (4) 
Recalling that X = VGW, 
therefore XX’ = VGWW'G’V' 

= VGG'V' 
= VGV' 

This equation can be solved using the familiar Hotelling principal 
axes algorithm. The number of principal roots and vectors may be de- 
termined by inspection and BN is easily computed using equation (2). 

Since B*, Y*; =X,,, 
pre-multiplying both sides by B*}, yields 


Be Bee Be ke (5) 
Also, 

Be=N-”% V,G, (see equation (2) ). 

Therefore 


ea NG Ve SN atGe Vie 
Substitution into equation (5) gives 
(N-% Gy Vi) (N-“ VG) Y*, = BY Ry 
N- Gi, ViV,G,Y*; =B* X, 
N-! G2, Y*, = B*t X, 
Yoo NGUB ak? 
Since the first k eigenvalues and eigenvectors of X are identical to 


those of sae the known data matrix X is substituted for Xx , giving us 
the solution 
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Y*, = NG, BY, X (6) 
where all terms on the right hand side of (6) are known. 


The Eckart-Young procedure shows that if se = BY, then 
€é(Xj; - Xj)? 1s a minimum for the selected k, ie., errors are minimized, 

where B*,. may be interpreted as the factor loading matrix 

Y*, may be interpreted as the factor score matrix. 

This model may be interpreted as follows, “the series of scores of an 
individual is a weighted sum of reference learning curves, the weights 
being the individual factor scores and the series of b’s for each factor 
forming a reference learning curve (Tucker, 1966, p. 483).”’ 


Unresolved Issues 


There are at least three decisions that must be made by the experi- 
menter who decides to use a component curve approach: 


1. Selection of data matrix for analysis. 
2. Number of learning curves to be considered important. 


3. How to rotate the axes to obtain meaningfully important learning 
curves. 


The answers to all three questions are presently dependent upon the 
context of the particular study in question. This will be illustrated in 
the example which follows. The theory of factor analysis does not, at 
least at the current stage of development, provide answers to these 
questions. 


The remainder of this paper will be devoted to an examination of the 
above methodology as it might be applied to an analysis of student per- 
formance in a computer-assisted instruction situation. 


Example 
Method 


Tucker’s validation of the component curve analysis was based on a 
sample of 24 subjects on a series of 21 learning trials. The present study 
had 20 subjects but had only a series of 5 learning trials. 

The subjects were volunteers from a class in Ed. Psych. 271 at the 
University of Alberta and consisted of first year undergraduate students. 
Initially 32 subjects participated in the study, however, only 20 of these 
were used for the present analysis. Four subjects were excluded because 
they were absent for one of the two trials and eight subjects did not 
satisfy the minimum criteria of interacting with the simulation exercise 
for at least five decision periods or ‘years’. 

The program which was used in this study simulated the operation of 
a large lumber company. The student played a role of manager of this 
company. He had direct control over the amount of money he wished to 
invest in the lumber mill, his investment in machinery (an aggregate 
value which covers trucks, chain-saws, and spare parts), and the amount 
of money he wished to borrow from a loan company. He also controlled 
the number of employees on the payroll, the area he wished to reseed 
with young seedlings, and he could set an upper limit on the area to 
be cut during the coming year. 
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The student was required to use a light pen to point to the variable— 
say staff—which he wished to change. He was then required to type in 
the amount corresponding to this change. All students were familiar with 
the terminals and the setting before actually using the simulation pro- 
gram. 

After the student had made his policy decisions, the computer calcu- 
lated the effect of these decisions and automatically displayed the results 
on the screen. It calculated cash on hand, value of sales, and value of 
total assets. It also showed the amount of land that was now cut 
over and barren, land under reforestation, and land containing harvest- 
able timber. The values of the mill and machinery were adjusted to re- 
flect depreciation. The student then made a new series of management 
decisions for another “year”, and the process was repeated. 

The computer system automatically maintained a performance record 
of the responses of each student. Thus, values of all variables, includ- 
ing latency times were known for each decision made by the student. 
Performance records were printed out after the student had completed 
his session, and the values of the relevant variables were used in the 
construction of graphs and in the statistical analysis. 


TABLE 1 


FOREST SIMULATION RAW DATA: ASSETS ($) FOR FIVE TRIALS 
BY EACH OF TWENTY SUBJECTS 


Subject - Trial: 
1 Z 3 4 5 
1 358.7 Sa 347.1 333.9 318.5 
va 388.7 382.4 31GL 368.4 361.8 
3 417.0 458.8 498.2 518.3 556.5 
4 361.7 356.9 363.1 351.0 358.8 
3) Slice BOG.2. 347.2 334.9 307.2 
6 376.2 374.6 376.0 31U,0 309.9 
I Siow 408.7 464.5 585.4 1189 
8 365.4 o0U.7 336.6 319.6 299.6 
9 Soo 388.0 540.9 oy Fome TOart 
10 365.4 346.6 325.6 307.9 278.7 
11 371.6 361.4 348.7 o2o 200.6 
12 396.4 S92 388.9 390.9 397.2 
13 370.4 376.6 379.9 3179 313.9 
14 394.2 421.5 484.0 567.0 673.6 
15 375:7 355.9 Pf | 289.4 234.6 
16 359.8 348.2 334.6 oe tas 318.7 
17 36015 389.5 411.9 428.6 449.7 
18 316:3 424.7 466.9 519.3 585.1 
19 384.2 383.2 413.8 439.9 467.7 
20 SOO Batt 317.0 293.8 248.1 


' A learning trial is defined as one ‘year’ of decision making for running the lumber 
company. 
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Analysis 

The raw data for each individual (Table 1) consists of the value of 
the “assets” variable over the number of years, or trials, of operation. 
The value of assets reflects the values of cash, mill, land cut, land re- 
seeded, land available for cutting, and machinery and thus represents a 
composite of all the variables in the model. 

Ross (1964) discussed the difference in factor structure resulting from 
the factorization of correlations, covariances, and cross products and 
recommended the use of cross products for factoring learning data since 
this method retains information on both means and variances. This 
suggestion was followed in the present study since such information re- 
presents an important feature of the data.’ 


Tucker used two methods for determining the number of learning 
curves required to account for the data. The first method uses mean 
Square ratios similar to the variance ratios used in analysis of variance. 
A test similar to that used in analysis of variance is used to determine 
the number of learning curves. Using the formulae provided by Tucker 
the five mean square ratios in Table 2 were computed: 


TABLE 2 
MEAN SQUARE RATIOS FOR COMPONENT CURVE ANALYSIS 


Factor af. df . Mean Square Ratio tae 
1 24 76 158.6 2.4 
2 ps 54 78.8 25 
3 20 34 7.0 2.7 
4 18 16 wer Bee 
5 16 0 0 


Investigation of the above results suggests that three components 
should be retained. 

Tucker’s second criterion for determining the number of components 
is based on the concept of external validity. Thus if a learning component 
curve is to be considered meaningful (i.e. it represents a consistent 
learning behaviour instead of a fluctuating random behaviour) it should 
form a smooth curve. The left characteristic vectors were graphed for 
the first four components. The first two components satisfied this cri- 
terion whereas the last three showed increasing random-like fluctuation. 
Therefore taking both criteria into consideration it was decided to re 
tain three components. In effect, to reproduce the original learning scores 
over the 5 trials the weighted sum of the 3 curves would be necessary. 

The next step of the analysis obtains the loadings of the trials on the 
component curves. The results of this step are provided in graphical form 
(Figure 1). 

An examination of the three unrotated components leads to the 
following three observations: 
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(1) Component 1 has an initial high value and increases steadily at 
a slow rate over 5 trials. 

(2) Component 2 has an initial very low value and increases rapidly 

over 5 trials. 

(3) Component 3 has an initial low value and shows a slight fluctua- 

tion over 5 trials. 
Thus it is possible to interpret component 1 as representing sure steady ° 
performance, component 2 as representing initially poor performance 
but able to profit by mistakes, and component 3 as representing con- 
sistently poor performance. 

The last step involves solving aquation (6) for Y*;, to obtain the weights 
for each individual on each learning curve, thus indicating the extent 
to which his learning follows each of the learning curves. The results 
are given in Table 3. 


490.00 570.00 


410.00 


330.00 


Factor Loadings 
170.00 


10.00 90.00 
) 


-70.00 


0.00 1.00 2.00 3.00 4.00 5.00 6.00 
Trials 
Figure 1. Factor loadings of trials on three component curves. 
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The last remaining issue is that of rotation. There are two principal 
reasons for rotating the axes: 

(1) to enhance the meaningfulness of the learning curves, and 

(2) to provide maximum separation among the subjects. 


At present there are no firm guidelines as to what constitutes a mean- 
ingful or desirable rotation. Tucker considered the criterion of simple 
structure in the trial space but rejected the idea on theoretical grounds—he 
was unable to justify why one would want many zeros in the component 
curves over trials. He also looked for simple structure in the person 
space to see if individuals followed different component curves but the 
results were negative. He finally used a graphical procedure for rotation 


TABLE 3 
FACTOR SCORES OF TWENTY SUBJECTS ON UNROTATED COMPONENTS 


Component 
Subject WMibabitiants Sot) A aula Ss 
1 0.850 -0.687 -0.231 
a 0.931 -0.615 -0.426 
3 1.225 0.244 0.674 
4 0.890 -0.451 -0.404 
DB 0.858 -0.854 -0.372 
6 0.922 -0.543 -0.006 
J 1.320 1.967 -2.378 
8 0.827 -0.805 -0.477 
9 1.389 2209 2.481 
10 0.802 -0.918 -0.516 
it 0.791 -1.415 2.347 
12 0.978 -0.465 -0.630 
13 0.934 -0.437 0.035 
14 1.279 rh -0.370 
15 0.783 -1.282 0.048 
16 0.837 -0.651 -0.654 
Li 1.021 0.022 0.334 
18 1.191 0.721 0.329 
19 1.043 0.080 -0.005 
20 0.765 -1.033 -0.084 


that is used sometimes in factor analysis where abilities are being 
studied, namely such that all component curves had non-negative entries, 
non-negative slopes, and that they all reached an asymptote. 

In order to provide more data on this issue it was decided to in- 
vestigate the criterion of simple structure in either the trial or person 
space. At present the restriction to an orthogonal rotation appears de- 
sirable since this ensures the independence of components. It is possible 
that oblique rotations will come into use at a later date after more 
development with the procedures has taken place. Three procedures for 
an orthogonal rotation to a simple structure criteria were used: quarti- 
max, varimax, and equamax. 
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A simple structure in the trial space could be interpreted as follows: 
at different stages in the learning situation a single component adequately 
describes the variation in performance. For example, component 1 might 
account satisfactorily for the data on the first two trials, component 2 
for the third trial, and component 3 for the last two trials. The results 
of the three rotations to the present data were negative—there was no 
evidence of simple structure. 


A rotation in the person space involves applying an orthogonal trans- 
formation to the factor score matrix. A simple structure in this situa- 
tion could be interpreted as showing that certain individuals follow a 
unique component. The quartimax rotation gave the best results. Seven- 
teen of the twenty students could be identified with a single component. 
The graph of the quartimax rotation is given in Figure 2 and the rotated 
factor score matrix for the quartimax given in Table 4. 


TABLE 4 


FACTOR SCORES OF TWENTY SUBJECTS AFTER 
QUARTIMAX ROTATION IN PERSON SPACE 


Component 
Subject 1 2 3 
1 1.104 0.108 -0.072 
Z 1.183 0.102 0.133 
3 0.509 1.303 -0.238 
4 1.043 0.173 0.201 
5 1.264 -0.050 -0.056 
6 1.000 0.340 -0.170 
( 0.441 0.796 a2! 
8 1.244 -0.097 0.053 
9 -1.186 3.365 -0.569 
10 1.310 -0.193 0.017 
11 0.724 0.936 -2.595 
T 1.185 0.114 0.390 
se 0.929 0.425 -0.142 
14 0.261 1.349 1.167 
15 1.350 -0.125 -0.650 
16 1.209 -0.094 0.285 
17 0.609 0.877 -0.115 
18 0.292 1.366 0.306 
19 0.694 0.758 0.197 
20 begat -0.068 -0.404 


Referring to Table 4, it may be noted that twelve students (1, 2, 4, 
d, 6, 8, 10, 12, 18, 15, 16, 20) have a high factor score on component 
1, three students (3, 9, 18) have a high score on component 2, and two 
students (7, 11) have a high score on component 3. The remaining three 
students (14, 17, 19) have high factor scores on two of the three com- 
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ponents. These results of rotation in the person space are encouraging, 
and should lead to a clearer examination of individual differences. 
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Figure 2. Factor loadings of trials on curves after quartimax rotation. 


Conclusion 


The present study has illustrated the suitability of Tucker’s com- 
ponent curve analysis for looking at a new development in education— 
that of using simulation games and models as a method of instruction. 
Furthermore it brings into focus the issue of individual differences 
and since three learning curves are required to account for the learn- 
ing data, it shows the unsuitability of a generalized mean learning 
curve for summarizing data in this type of situation. 

It is recommended that subsequent studies include a number of 
independent external measures for each subject. This should aid in the 
identification and interpretation of the respective components (rotated 
or unrotated). This will also provide important links with the existing 
body of knowledge in the field of learning theory. 


127 


J. Burnett 


References 


Cattel, R. B. (Ed.) Handbook of multivariate experimental psychology. Chicago: 
Rand McNally, 1966. 


Duncanson, J. P. Intelligence and the ability to learn. (Doctoral dissertation, 
Princeton University) Ann Arbor, Mich.: University Microfilms, 1964. No. 
65-4908. 


Eckart, C. T. and Young G. The approximation of one matrix by another of: 
lower rank. Psychometrika, 1936, 1, 211-218. 


Harman, H. H. Modern factor analysis, (second edition, revised) Chicago. The 
University of Chicago Press, 1968. 


Ross, J. Mean performance and the factor analysis of learning data. Psychometrika, 
1964, 1, 67-73. 

Tucker, L. R. Determination of generalized learning curves by factor analysis. 
Office of Naval Research Technical Report. Princeton, N.J.: Educational 
Testing Service, 1960. 


Tucker, L. R. Learning theory and multivariate experiment: Illustration by de- 
termination of generalized learning curves. In Cattell, R. B. (Ed.), Handa- 
book of multivariate experimental psychology, Chicago: Rand McNally, 1966, 
476-501. 


Weitzman, R. A. A comparison of the performance of rats and fish on a pro- 
babilistic, discriminative learning problem. Office of Naval Research Techni- 
cal Report. Princeton, N.J.: Educational Testing Service, 1959. 

Weitzman, R. A. A factor analytic method for investigating differences between 
groups of individual learning curves. Psychometrika, 1963, 1, 69-80. 


128 


BOOK REVIEWS 


STUDENTS’ATTITUDES AND COLLEGE ENVIRONMENTS 
By J. McLeish, Cambridge Institute of Education, in Association with 
The University of Alberta, 1970. Pp. vii and 251. 


Dr. McLeish joined the staff of the Department of Educational Psy- 
chology, University of Alberta, in 1969. Previously he had been Research 
Fellow at the Cambridge (England) Institute of Education which is an 
association of about a dozen colleges for the training of teachers in 
Cambridge and the surrounding area. This monograph reports one of 
his main research activities, namely, a survey and analysis of the at- 
titudes to education, the values and certain personality characteristics of 
different groups of student teachers, and the changes—if any—brought 
about by their course of training. Virtually the whole intake of 1,671 
students (in 1965) was included, and nearly 90 percent of them took 
the same tests again 2 or 3 years later. Some 1,500 other persons filled 
in all or most of the tests. Though mainly educationists, they ranged 
from Prison Officer tutors to Hawalian-Japanese students, and from 
nurses to school dentists. Indeed this was a mammoth exercise to be 
undertaken almost singlehanded by the author, his wife, and a computer. 


The results as such will be of less interest than they might be to 
Canadian readers because many of the categories of English students 
will be unfamiliar; and there is nothing in North America quite cor- 
responding to the English residential training college (nowadays 
dignified by the title College of Education), which chiefly trains non- 
graduate teachers. It is unfortunate, too, that the very small numbers 
of men in the main sample (130) make the results on sex differences 
nugatory. Nevertheless many aspects of the methodology, and the tests 
used, are worth the attention of anyone concerned with large-scale 
attitude surveys. 


A rather short chapter summarizes the literature on changes in stu- 
dent attitudes, and there is a bibliography of 430 titles. Special attention 
is given to the work on attitudes to educational issues carried out at 
Manchester under Professor Oliver. The author points out that many 
of the published studies consist of cross-sectional investigations, and 
also that control groups are conspicuously lacking. He was abie to sep- 
arate out the changes attributable to training college courses by con- 
trasting his students with students of nursing, whose attitudes over the 
same length of time were relatively stable. 

The study began with semi-structured interviews with 61 advanced 
students, designed to provide varieties of opinions about educational 
matters. However the taped material proved so difficult to analyze that 
Dr. McLeish eventually decided to use published tests (with minor 
modifications), including Oliver and Butcher’s educational attitude scales, 
Eysenck’s MPI and social attitudes scale, and other tests of values, job 
satisfaction, etc.—a total of 31 variables. All of these are given in the 
Appendix in full, and should be of considerable use to other investigators. 
Additional pilot work was done with 300 written educational autobio- 
graphies. Attempts to reduce these to quantitative indices by rating the 
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attitudes that they portrayed proved too time-consuming and too sub- 
jective. One might question, though, whether modern techniques of 
content analysis of such open-ended material might not have yielded 
more usable data. 

Further work was done on the assessment of college characteristics, 
both by combining objective indices (e.g. proportion of male staff), and 
by student ratings. Wide differences in ‘climate’ between the ten pat- 
ticipating colleges were revealed, though the objective and subjective 
approaches often failed to agree. It proved possible to link some of the 
differences in ratings to differences in the raters’ own attitudes or 
values. For example, the lecture method was generally unpopular, but 
it was approved more often by the more stable and generally conserv- 
ative students. 


The major finding is that the students’ social and educational opinions 
tended to become more progressive, more humanistic in the course of 
their training, and less dominated by narrowly religious views. On the 
other hand changes in personality and values were relatively slight. 
These and other conclusions are fully documented and lucidly explained. 
One might, however, add a mild criticism that so much space is taken 
up with details of the scores of various sub-groups and other non-college 
groups. Naturally there are differences which are often plausible and 
revealing. But, as in most survey studies, one gets very little out of 
descriptive data which were not collected on the basis of preformulated 
hypctheses. 


P. E. VERNON 
The University of Calgary 


LIBRARIES AND EDUCATION 
By Cecily Brown. Quarterly Review of Australian Education, September 
1970. Melbourne, Australian Council for Educational Research, 69 pp. 


Miss Brown, who has had experience in university, public and state 
libraries, is Librarian-in-Charge at A.C.E.R. and is Editor of the 
Australian Education Index. She is thus well fitted by experience, posi- 
tion and opportunity to comment upon libraries and education. Her report 
gives a brief, well-balanced and up to date, though in parts superficial, 
introduction to the problems facing libraries in Australia. 

The report is obviously too short to do else but highlight obstacles 
to libraries fulfilling their full educational potential. The main require- 
ments are adequate finance for planned and effective growth, the need 
for increasing numbers of trained librarians and, in the schools, a need 
for State Departments of Education to revise the method of providing, 
staffing and utilizing school library facilities. 

In her report, Miss Brown devotes most of her attention to School 
Libraries (21 pp.) and to Teachers’ College Libraries (17 pp.) for it is 
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in these two areas that students’ and, subsequently, teachers’ attitudes 
towards libraries as educational facilities are established. But the prob- 
lems of school libraries are more complex than indicated. For example, 
libraries are often ineffective in new schools for many years because 
inadequate planning of the establishment phase compels them to start 
from small beginnings. Teachers and students are thus obliged to rely 
heavily on text books alone. In 1947, McColvin'! commented adversely 
on this aspect of library policy, apparently with little result. 

School libraries are staffed by teachers with only a smattering of 
library training. As teacher/librarians, most are attached to English 
departments in secondary schools and all are required to demonstrate 
teaching skill for promotion purposes. This often means that they will 
teach a class in English for a certain time each week. Their library 
duties, for which they are allowed two hours per week, thus assume 
lesser importance, for promotion is not possible solely as a librarian. 


This policy affects the provision of library services and the attitude 
of students and teachers to the library as an educational facility. Students 
and teachers, alike, regard “Library” as a subject and the responsi- 
bility of the librarian, while the use of the library as a classroom limits 
its general availability to a fraction of the week. Teacher/librarians 
also act as substitute teachers, further diminishing their ability to pro- 
vide library services. The need to replace inadequately trained teachers 
with fully trained librarians would appear to be self evident, but strong 
interests within the Departments resist such changes. 


Shire and Municipal libraries, which provide special services to 
develop children’s reading interests, and provide general reading and 
educational material, receive little attention in this report. In many areas, 
such libraries often compensate for school library services during out- 
of-school hours. Although not trained as teachers the librarians’ provision 
of materials and services of interest to children has been of a high 
order. 


Data on increasing library expenditures, and the apparent decline in 
the belief that libraries represent ‘“‘educational frills’, provide a_ heart- 
ening prospect that Australian libraries are, at last, emerging from the 
era of apathy and indifference. 


ALAN HELLYER 
The University of Alberta 


' Public Libraries in Australia, Melbourne, M.U.P., 1947. 


131 


NOTES ON CONTRIBUTORS 


J. DALE BURNETT is a Graduate Research Assistant with the Division of Educa- 
tional Research Services at The University of Alberta. He is presently engaged 
in doctoral studies in Educational Psychology. Mr. Burnett holds a B.Sc. (Hons.) - 
in Mathematics from The University of Alberta and is interested in computer- 
assisted instruction. 


LARRY EBERLEIN, Associate Professor of Educational Psychology, has been at 
The University of Alberta since 1967. Dr. Eberlein has published articles in the 
Journal of Educational Research, Counselor Education and Supervision, The Western 
Psychologist, and is author of the book Sensitivity to People and Messages. 


ARTHUR ELLIOTT holds the degrees B.Sc. and M.Ed. from The University of 
Alberta and an Ed.D. from the University of California, Berkeley. Dr. Elliott is 
Assistant Professor at Simon Fraser University and is a member of the Profes- 
sional Advisory Committee for The Educational Research Institute of British 
Columbia. 


ALAN HELLYER holds the degrees B.A., M.Ed. (Hons.) from the University of 
Sydney, Australia, and a Diploma in Education from the University of New Eng- 
land. He has taught for many years in secondary schools in New South Wales 
and is presently engaged in doctoral studies in Educational Administration at 
The University of Alberta. 


HENRY W. HODYSH is Associate Professor in the Department of Educational 
Foundations at The University of Alberta. Dr. Hodysh has published in Educa- 
tional Theory, History of Education Quarterly, The Journal of Teacher Education, 
and in this Journal. He is interested in applying the theory and philosophy of 
history to educational problems. 


MICHAEL J. A. HOWE is Associate Professor of Educational Psychology at The 
University of Alberta. He holds the degree Ph.D. from the University of Sheffield, 
and has held appointments at Dalhousie and Tufts Universities. Previous publica- 
tions include articles on memory, and human learning and a book, Introduction 
to Human Memory. 


GILLIAN S. KELLOGG holds the degrees B.A. from Smith College and M.A. 
from Tufts University, specializing in the teaching of foreign languages. Mrs. 
Kellogg has taught foreign languages in Elementary and Junior High Schools in 
Massachusetts. 


ETHEL M. KING is Professor of Curriculum and Instruction at The University 
of Calgary. Dr. King is a member of the Board of Directors of the International 
Reading Association. She has published articles on curriculum and research in 
reading and early childhood education and the Canadian Tests of Basic Skills. 


WAYNE MATHESON holds the degree M.Ed. in Counselling Psychology from 
The University of Alberta. He is presently engaged in doctoral studies in Social 
Psychology at the same university. 


SIEGMAR MUEHL is Professor of Educational Psychology at the University of 
Iowa, and was Director of the Children’s Reading Clinic. Dr. Muehl has recently 
served with the College Education Achievement Project, a compensatory program 
for black high school graduates in Charlotte, N.C. He is author of research 
articles in beginning reading and reading disability. 


132 


JAMES PARK holds the degree M.Ed. in Counselling Psychology from The 
University of Alberta. He is presently engaged in doctoral studies in Educational 
Psychology at the same university. Mr. Park has published and presented a num- 
ber of papers in counselling psychology. 


STANLEY A. PERKINS is Associate Professor of Educational Psychology at The 
University of Lethbridge. He holds the degrees B.Ed. from the University of 
British Columbia and M.Ed. and D.Ed. from the University of Oregon. Dr. 
Perkins was formerly Assistant Professor at the University of Puget Sound and 
was Director of Counselling at The University of Lethbridge following its inaugura- 
tion. He has published articles in the Alberta Teachers’ Association Magazine, 
The School Guidance Worker, Counselor Education and Supervision, and The 
Journal of Creative Behavior. 


P. E. VERNON is Professor of Educational Psychology at The University of 
Calgary. Dr. Vernon was previously Professor of Psychology at the University 
of London Institute of Education. His main publications include: The Measure- 
ment of Abilities, The Structure of Human Abilities, Personality Tests and Assess- 
ments, Intelligence and Attainment Tests, Personality Assessment: A_ Critical 
Survey, Intelligence and Cultural Environment. 


133 


’ ” i | % is 
bd 7 on. \y , 
| ot  ¢, ae om - vl y 
behets “o a 
i Se. —_ an 
@ ) ee! me pls 
sand s ie apewnte 
a As lad ; 
mit o' eal 


. e 
stv 6 «th » af 


(eves ay a vi> a “pee 
ahh, ae ch A iets Ciardinus ae ma 

ent Ww ay ieee 1A, ew iy -<« 

* enh mayen A hepa) 


ay ote 


RESEARCH IN EDUCATION 


Edited by H. J. Butcher and E. Hoyle 


CONTENTS OF NUMBER 5, MAY, 1971 


D. Child and 
A. Smithers 
P. D. Pumfrey 


W. Hopkins 


E. A. Yoloye 


P. R. Abramson 


N. Morris 


B. Shaw 


Book Reviews 


Some Cognitive and Affective Factors in 
Subject Choice 


Effect of a Selection Procedure on the 
Placement of Children in Special Schools 


Assessing Students’ Behaviour in Group 
Discussions 


The Effects of Schooling on the Performance 
of Bilingual Students on Tests of 
Intelligence 


Educational Certification and Life Chances 
Among British Schoolboys 


Education and the Coming of the General 
Grant—IlI 


Education as an Applied Science—A 
Critique of Theory and Research 


RESEARCH IN EDUCATION is published twice-yearly, in 
May and November, by Manchester University Press. Annual 
Subscriptions are $7.00 (post free); single copies are $4.00. 


MANCHESTER UNIVERSITY PRESS 
316-324 Oxford Road, Manchester M13 9NR, England 


ey 4c i“ =19 
Sa i eT 
sate lr 


r 
F \ a ~ 
> ieee i 762 Ras, él 
1 a $55 ve J 
pity ; i LTE ae 
a 
; is Aria. 
=) 
’ =.) 
-_ Flas © - 
: ’ 


» 
hey é ! i ee | aa % > 
a 
ed all 
‘ are? 
a . Pas 
i; : 
rt St ery a Ae eee 7 _ c 
f ss ” 
a 


Horeenniind tas a ws nore aaa 
“e0G yinetett aed sail 
ubtnew tatna Ares ss VG, gam 


4 a nS Vas STA ny 
Mad 

res Seat v, 
bac = rn 


) feat: noe’ 


NOTICE TO SUBSCRIBERS 


Back issues of The Alberta Journal of Educational Research are available 
from the Editor at the following rates: 
Vols. 1 through 11 $25.00 per complete set 
or $ 2.40 per volume. 
Vols. 12through16 $22.50 per complete set 
or $ 5.00 per volume. 
An Abstract of Articles published in the A.J.E.R. between 1955 and 


1965, compiled by Dr. F. Enns, Associate Dean of Education, The Uni- 
versity of Alberta, is available at $2.00 per copy. 


ORDER FORM 


To The Editor, 

The Alberta Journal of Educational Research, 
839 Education Building, 

The University of Alberta, 

Edmonton 7, Alberta. 


Please supply the following back issues of the A.J.E.R. 


Vols. 1 through 11 at $25 per set. No. of sets required .................04. 
Individual volumes at $2.40 per volume. 
Volume required ..............0:006 NG, of CODIESG. cae 


Vols. 12 through 16 at $22.50 per set. No. of sets required ........... eee 
Individual volumes at $5.00 per volume. 
Wolinie TOQUE devessicsnrserwenns ING. Of GODIGS somes ecenee 


Abstract of Articles at $2.00 per copy. No. of copies required .............:000 


PPT TTT TTT TTT TT rrrrrreeeerrreeeee Teer irr 


cece cece cece eee e ee eee eee eH Oe SEE EE HEHE EEEEESEESHOEEEEHEOOOESEEESEE SSE EEESEESEEHETEDEESOOOOED 


; Pi 
on | 
; 
f } } 
‘ 
, ; a 
5 
lk ut ud 
iat ays ll 
oy \ a | 
t 
© dnd i a 
yy hh Md i \ 
i ih ny j oe a 


. 


hak VAAL A bs 
a bie aaa L, 
oll 


he hay iy Mi St } 


Kueh ie 


Nee: 
v : M { - 
ee 
tia Ee 4) 8 
; saya ie 
on er: ’ 
ay ay, - aA) 
hee wee 
Fs 
oe y 
eh,” dear | 
- | r 


o 


, saa Lb oe ih aie 
crea eo i spay 
me Ay, Fa i aa a A 


i U r 
ee 


veh a 7 , F print Mh fy 


avi eee 


i 
y 4 
ind a i 
i £ 
j Pia y 
7 mae.) eons | 
“4 4 
? fe i 


( uu | f 
AE ih) iS ald 
ALweL, Latah 
; ay f 


The Alberta Journal 
of 


Educational Research 


Vol. XVII, No. 3 September, 1971 
CONTENTS 


The Nature and Functions of Biographical Studies in 
Me aes LOWS yey ALIA LST Bee, = es 2 Ya cy onslrersicdauseis«<soseuu0¥devesovelanatyes osan poops aumcoeas oeteees 135 
Nick Kach and Peter J. Miller 


Beaenematics Learming and FUpl) CHATACTELISTICS. .......-.-....c-0-ccesesseceovnscesnesssersevdasnecsees 143 
Werner Liedtke 


Development of Some Non-Instructional Components in a 
SEE TE yeT tes SCE 11 wees eer aI, UN A Se BOSS ici Ja Mb sdllek Saucnecebobbesksl soabaaceedsn Pave EG 155 
E. A. Holdaway and R. A. Duboyce 


The Use of Reading Tests for Entrance and Placement Testing 
PnemeeCe TIWETIAITYUL ON ORL Were Vos eee PDE Rh oes vata is nav vous Wie ttacteeect teas onaevia tear ahecealeee 165 
Henry L. Janzen and Edwin, F. Johnston 


Learning Spelling Through the Use of Electric Typewriters ...........cccceessesesseeeeeseeeeees 173 
Stanley A. Perkins 

Effectiveness of Participative Teaching Methods .............ccesssscessesesssseeseeeeseeeesseeesnes 179 
Antoine Papaloizos and Rolf Stiefel 

Pacomment on A Soviet and Western Concept Of Set” ...............cc.sssessessenenssansssesnavenees 191 
J. Dale Burnett 

UME Ua ice LOUIE TIGL  eeter cca ocathaces pa cdivasacversasletersensns onsihiessesexonsddsuescips stkehuntunghseianinsayt 192 
John Hritzuk and Henry L. Janzen 

BOOK REVIEWS 

Contemporary Influences in Early Childhood Education .........cccccceseeseseeeeeeseeesennees 195 
Janis Blakey 

est ound ations. of Modern EGUGation ...:.:...:00-.sctsisasiercersseesenpeasceossnansonsaosinenndagubssenennenenn 196 


Henry W. Hodysh 


Helping and Human Relations: A Primer for Lay and Professional 
LG ST Gc iris, Sat eta nk tecctt ve iselochsetiawcvscusstvbesnsasdvbudesbsupanoaddeasvouseusitvne ddontensh eaneaes cos Givepeienaaunns 198 
D. Donald Sawatzky and Kathy Cormie 


MRE NEY Co STICELLNILOLE 2 oscaesiiecde.cucsc es eviveovsvidespevecacovevannesasapesnatasecesbucsanscnnasp/soassavssvieavansenshad 200 


FACULTY OF EDUCATION 
The University of Alberta 


EDITOR’S NOTES 


This issue contains articles from varied fields of interest: history of edu- 
cation, instruction, counselling, and administration. We have also in- 
cluded an article on the opinions of management teachers about the 
effectiveness of participative teaching methods. Our readers will be 
able to speculate about some interesting implications for teaching in 
schools as well as for teacher education. 


AJER gratefully acknowledges the continuing financial support of the 
Alberta Advisory Committee for Educational Studies. For many years 
AJER was produced jointly by AACES and the Faculty of Education; 
although publication and management are now the responsibility of the 
Faculty of Education, the annual grant from AACES is essential for the 
continuation of the present service to our subscribers. 


cece ee 


December AJER will be a theme issue on Research and Development 
in Education. The issue is being produced in cooperation with the AIl- 
berta Human Resources Research Council and will feature analyses of 
HRRC’s major R and D projects in education. 


oo ee ee 


Copies of all back issues of AJER are still available. We would appre- 
ciate the efforts of our readers in drawing this to the attention of 
librarians if existing sets are incomplete. An order form is provided on 
one of the last few pages in this issue. EM 


The Alberta Journal of Educational Research 
Vol. XVII, No. 3, September, 1971 


NICK KACH 
and 


mie ReJaMTiL ER 
The University of Alberta 


The Nature and Functions of Biographical 
Studies in the History of Education 


The biographical approach to the history of education continues to 
be popular. All too frequently, however, those who employ this ap- 
proach fail to: consider the methodological problems inherent in 
biographical studies. In this paper, the relationship of biography 
to history is explored through an examination of the kinds of histori- 
cal explanation which can be provided by such studies. It is argued 
that such studies are a legitimate and useful form of historical 
research but that, due to the ‘parochialism’ of history of education, 
their full explanatory potential has not yet been realised. 


One of the more noticeable features of the vast body of recent re- 
search into the history of education is the large number of biographi- 
cal studies. Indeed, as early as 1952, Sir Lewis Namier recognized that 
“biographies have become the ritualist form of English historiography 
...[and] predominate as much as portraits do in English oil-paintings 
...- (Clifford, 1962, p. 188).” 


The reasons for their popularity are difficult to give with certainty, 
although easy to guess. Doubtless the growing interest in biography as 
a literary form has had its effect (Garraty, 1957, p. 151). It may be 
that biographical studies do, in fact, perform certain essential functions 
in the history of education, for as Creighton points out, “We can only 
understand ideas when exhibited in their application to actual life... 
[and] movements are only intelligible when described in terms of in- 
dividual endeavour (Creighton, 1903, p. 305).” The most likely explana- 
tion, however, is that on the surface biography appears to be an un- 
exacting form of historical research. Source materials fall readily to 
hand, and the genre appears to be based upon no formal techniques— 
a kind of ‘go-as-you-please’ narrative or account. Just as the reading 
public selects biography because it is supposed to be easy reading, so 
the researcher selects it because it is supposed to be easy writing. 
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It is true that literary critics have, in recent years, devoted consider- 
able attention to the critical study of biography as a literary form, al- 
though quite understandably their major interest has been in the com- 
plex psychological and aesthetic problems involved in the recreation of 
character.! It is also true that historians and philosophers of history 
have recently attempted to relate the methodological problems of 
biography to the broader more fundamental questions of historio- | 
graphy.? Unfortunately, this recent and very healthy interest in the 
nature and possible functions of biographical studies has exercised but 
a slight influence upon history of education. The relationship of bio- 
graphy to history of education, the kinds of significance which can 
legitimately be attached to such studies, and the effects of traditional 
historiography of education upon them, are surprisingly neglected issues. 


Positivism, History, and Biography 


It is only during the last one hundred and fifty years or so that the 
biographical approach to history has had to be defended as a legiti- 
mate mode of explanation. Before this time, for laymen and historians 
alike, events in history were felt to be explained most adequately by 
referring to the thoughts, motives and actions of the so-called ‘great 
men’ or ‘leading figures’. Ironically, it was in that great age of hero- 
worship, the nineteenth century, that such ‘positivistic’ thinkers as 
St. Simon, Compte and Marx effectively challenged such a mode of his- 
torical explanation and understanding. For them, as for all ‘scientific 
positivists’, the aim of any enquiry into the nature of man and society 
should be to discover or establish general laws having both an explana- 
tory and predictive power. In our own century, such an butlook and 
such a concern have been greatly strengthened by two further develop- 
ments: (1) the enormous strides made by the social sciences, particu- 
larly economics and sociology, and (2) the dominance in philosophy of 
logical positivism or scientific empiricism, and its more recent offshoot, 
linguistic analysis. 

The intellectual climate produced by such ideas and movements have 
made it difficult, if not impossible, for historians to avoid being drawn 
into a debate about the relationship of history to science. For if the 
essence of science is to be found not so much in the subject matter 
of an enquiry as in the nature of the explanations it provides, it would 
seem to follow that no study, not even an historical one, can claim to 
be exempt from the universal responsibility of all disciplines to try to 
become scientific. Only the reluctance of historians to abandon their 
outmoded models of explanation and to adopt the method of science 
could prevent history from becoming as objective, as methodologically 
sound, as ‘scientific’ as any other ‘natural’ or ‘social’ science (Hempel, 
1966, pp. 95-126). History, in fact, must no longer be looked upon as 
an ‘idiographic’ field of study, concerned “to understand the unique and 


' For a complete bibliography of literary criticism of biography and its relationship to literature, see Gar- 
raty’s excellent “Essay on Sources,” (Garraty, 1957, pp. 261- 289.) 


* Representative treatments of the problems involved in determining the relationship of history to science, 


and biography to history are those given by Danto (1963), Dray (1964, pp. 4-20), Mandelbaun (1957), 
Berlin (1960), and Walsh (1961). 
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non-recurrent”; rather it must be considered a ‘nomothetic’ investigation 
establishing “abstract general laws for indefinitely repeatable processes 
(Nagel, 1959, p. 203)’. 

It is easy to see why those who hold such views have been led to 
the conclusion that there are irreconcilable differences between the 
natures of biography and history. If history is not concerned with in- 
dividual actions but with “mass phenomena”, then it is the typical rather 
than the unique which should occupy the historian’s attention. Studies 
of communities, classes, nations, institutions, movements, and ‘types’ 
are the only legitimate objects of historical enquiry, while studies of 
individuals, biographies, which seek to explain the development of a 
unique personality, are by definition non-historical in nature. Put 
simply and bluntly, in the attempt to approximate history more closely 
to those enquiries which are truly nomothetic, some historians and 
even more philosophers of science have felt obliged to lop off those 
of its branches which seem to them to be particularly idiographic, in- 
cluding that apparently most idiographic of studies, biography. 


There has, of course, been no lack of champions of the autonomy of 
history ready to do battle with ‘scientific’ historians and to defend the 
legitimacy of biographical studies as a form of historical research. How- 
ever, the dispute has generally reduced itself to a debate about the 
causal significance of individuals in history and the validity of a ‘great 
man theory’ of historical explanation.‘ In many ways this has been un- 
fortunate. Apart from the conceptual confusions generated by the term 
‘great man’, whenever a defender of ‘biographical history’ becomes in- 
volved in an argument about causation in general and historical causa- 
tion in particular, he fights the battle on grounds of the enemy’s choos- 
ing. For even if the historian were to grant that biographical studies 
possess a minimal power to give adequate causal explanations of large 
scale movements and social changes, it might still be the case that such 
studies can contribute to an understanding of those ‘mass phenomena’ 
which all would agree can be assigned ‘causal significance.’ A far more 
useful approach to the question of the relationship of biography to his- 
tory is. to point out and examine the functions which can be assigned 
to biographical studies in assisting historians of education to explain 
and understand the past. 


Relevance of Biography in History 


One of the more penetrating and fruitful analyses of the historical 
uses to which biographical information can be put is that made by Max 
Weber (1949, 137ff). Criticizing Meyer’s view that biographical facts have 
little relevance for historical understanding, Weber demonstrates quite 
clearly the impossibility of labelling any such facts of historical signifi- 
cance or mere human interest until the uses to which they are put are 
clearly stated and carefully examined. He considers, as an example, the 


3 See, for example, Meyer’s view of history and historical explanation and its refutation in Weber (1949, 
pp. 137ff). 

4 Good examples of such debates are provided by the views of history expounded by Thayer, Cheyney and 
Andrews, and discussed by Ausubel (1951, pp. 286-295). 
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letters of Goethe to Frau Von Stein, and investigates the possible hi- 
torical significance of the facts “which are disclosed by an ‘interpre- 
tation’ of... [their] meaning (Weber, 1949, p. 139).”’ 


In the first place, they may be looked upon as ‘causally effective’ 
phenomena, links in a causal chain, which explain preceding and sub- 
sequent developments. The attempt to establish causes and effects is, 
of course, a legitimate enterprise in history. Thus, 

to investigate [the] effects [of the letters] in Goethe’s ‘personality’, to trace 

their influence in his creative work, and to ‘interpret’ them causally by 

showing their connection with the events of those years...are among 

the least questionable tasks of literary history (Weber, 1949, p. 139). 


Weber, in fact, grants causal efficacy in history to thoughts and actions 
in the lives of individuals. 


It might be argued here that this type of historical-biographical 
explanation is legitimate only when applied to events in the lives of the 
‘great men’ of history. The decisions and actions of ‘minor characters’ 
will rarely, if ever, possess causal significance,—that is, they will not 
explain how subsequent ‘total situations’ in a society came about. 


But this argument involves a misinterpretation not only of Weber’s 
position but of the nature of history itself. If, in fact, the defining 
characteristic of a ‘great man’ is that events in his life and controlled 
by him possess ‘causal efficacy’, it follows that no individual can be 
labelled ‘major’ or ‘minor’ until the particular historical problem under 
investigation has been clearly stated and its spatial and temporal boun- 
daries established. The first mayor of a small town may well be a ‘major 
figure’ in any history of the town, and an absolute nonentity in a history 
of western civilization. The distinction, in fact, fails to discriminate 
and it is difficult to see what purpose is served by making it. 

What is important is that if ‘causal efficacy’ in determining the course 
of events be granted to any individual (and the issue here is philoso- 
phical rather than empirical in nature), then it must be granted to all; 
it then follows that biographical information can provide ‘historical- 
causal’ explanations and contribute in this way to an understanding of 
the past. 


There exist in addition, argues Weber, other types of historical explana- 
tion, ones that are not concerned with the discovery of causes and ef- 
fects. Consider again the letters of Goethe. It is possible that they could 
possess no causal significance. Assume that they were lost in the mail, 
quickly forgotten by Goethe, and only discovered yesterday. In that case, 
despite their obvious causal ineffectiveness, they might still acquire 
historical significance as ‘heuristic devices’. 

To begin with, the letters might reveal something about the personality 
of Goethe that is characteristic of his uniqueness or genius. Seen in 
this light they might help make possible a more complete explanation 
of the “causal nexus” of his life. 

Alternatively, even if it is demonstrated that the letters possess no 
causal significance and that they fail to reveal anything of the unique- 
ness of Goethe as an individual, they might still operate in another 
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fashion as a ‘heuristic device’ and acquire historical significance. They 
could, for example, represent some thoroughly typical aspect of his age 
and society. 


In that case, they would not tell us anything new for an historical know- 
ledge of Goethe, but they could...attract our interest as a convenient- 
ly useable paradigm of that type, as, in other words, a means of 
knowing the ‘characteristic’ features of the mental and spiritual atti- 
tudes of those circles (Weber, 1949, p. 140). 


Such a ‘representative significance’ can be found in the life of any 
individual, the question of ‘causal efficacy’ being ignored altogether. 
Consider, as an illustration, the decisions and actions of an obscure 
English clergyman in the late eighteenth century. Caught up in the 
general enthusiasm for the Sunday School Movement, he establishes a 
school in his parish and endeavours in this way to improve his ‘flock’. 
While the combined actions of the countless clergymen and laymen in- 
volved in the movement caused important changes in English society, 
those of this one particular clergyman were neither unique nor of great 
causal significance in the larger societal setting. But as a means of 
understanding the intellectual, theological and emotional climate of the 
movement, of ascertaining how schools were established and operated,— 
in short, of grasping the essence of the movement—a study of this one 
individual may be considered legitimate historical research. Indeed, in 
the final analysis, those who engage in such biographical investigations 
are handling the raw materials out of which have been or will be created 
the conceptual entities referred to as movements, classes, types and in- 
stitutions. 


Despite its brevity, the foregoing analysis should serve to indicate 
the variety and complexity of the types of historical explanation which 
can be given in biographical studies. And it is just this variety and com- 
plexity which make it essential for the historian of education to come 
to an understanding of the kinds of significance which can be attached 
to decisions, actions and events in the life of an individual. For while 
it is true that “the most comprehensive methodological knowledge will 
not make anyone into an historian, (Weber, 1949, p. 115),” it is also 
true that to ignore such knowledge is very likely to lead to historical 
malpractice. That such has been the case in a great deal of biographical 
research into the history of education is painfully obvious to anyone 
familiar with the literature in this field. Such biographical studies have 
suffered, in fact, from all the defects of the ‘traditional’ historiography 
of education. 


Biographical Studies and the History of Education 


Cremin has detected in Bailyn’s Education in the Forming of American 
Society (1960), three major criticisms of ‘traditional’ historiography of 
education (Cremin, 1965, p. 43). They are his denunciations of the sins 
of parochialism, anachronism and evangelism. All three sins have 
been freely committed and are clearly evident in biographical studies 
in the history of education. 
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Bailyn contends that the parochialism of history of education—that 
is, its preemption by educators and consequent preoccupation with 
formal pedagogy—has divorced the field “from the mainstream of 
historical research” and isolated education from its social context.® 


The effect of this parochialism upon biographical studies has been 
profound and unfortunate. In the first place, it has severely limited 
the selection of research topics, confining them to the so-called ‘great 
educators’ of history. More importantly, it has engendered and main- 
tained an overly conservative approach to the treatment of biographical 
materials. Historians of education in general and particularly those 
who employ a biographical approach have tended to be content to pro- 
vide simplistic ‘great-man-theory explanations of educational change 
and have been extremely hesitant to utilize the explanatory models 
developed by other disciplines. Their parochialism, in fact, has resulted 
in a marked lack of innovativeness, an unwillingness to experiment,—and 
the full explanatory potential of biographical research has consequently 
not yet been realised. 


In order to break down this parochialism, it is essential that historians 
of education abandon the notion that schools were “self-contained 
entities whose development... followed an inner logic and an innate pro- 
pulsion (Bailyn, 1960, p. 9).” They must instead conceive of education 
as the entire process by which a culture deliberately renews itself. If 
such a definition of education is accepted, then educational historians 
will no longer be able to confine themselves to studies of the institutions 
of formal learning and the men and women who worked in them and 
prescribed their aims, content and: methods. For example, in order to 
gain “historical leverage’ upon the role of education in colonial Ameri- 
ca, they will find it necessary to pay attention to the kinds of functions 
biographical studies can perform in ascertaining the educational and his- 
torical significance of the Church, the apprenticeship system, the family 
and the community. 


The assumptions bréd in educational historians by their parochialism 
have also led them to certain incorrect views of the nature of history and 
change. In their professional concern to search for the origins of those in- 
stitutions, ideas and practices they themselves were so familiar with, 
they have tended to see the past as nothing more than ‘the present writ 
small”. “They lacked the belief, the historian’s instinct, that the elements 
of their world might not have existed at all for others, might in fact 
have been inconceivable to them (Bailyn, 1960, p. 10).” As a result, the 
achievement of any real understanding of the past and the process of 
change was rendered difficult if not impossible. Indeed, as was the case 
with Cubberley’s ‘public school ideal’, it could cause them to see in the 
past, that which was not present at all. 


5 Much the same criticisms of the historiography of education were made by W. G. Shelton in a paper 
delivered at the Second Western Canada Conference on the Foundations of Education (1965). 

6 It is surely significant, in this connection, that the most innovative approach to biographical explana- 
tion in the history of education in recent years has been taken not by an educational historian but by a 
social psychologist, John McLeish, whose book, Evangelical Religion and Popular Education (1970), must 
surely rank as a major contribution to the historiography of education. 
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Biographical studies in the history of education have been parti- 
cularly prone to commit this ‘sin of anachronism’. Far too frequently, 
in the desire to push back the origins of an idea or movement as far 
as possible, causal links have been pointed out or implied between as- 
pects of the life and work of an individual and later developments where 
no causal chain can be shown to have existed. At the same time, the 
historical significance of an individual is seen in terms of the educational 
beliefs and practices of a future age. It is as if the historical signifi- 
cance of Leonardo da Vinci’s ‘airplane’ designs were to be assessed 
solely in terms of their causal influence upon the course of aviation de- 
sign in the twentieth century. 


In addition to succumbing to the temptation to give an undue causal 
significance to individuals in the history of education, the ‘educational 
biographer’ has compounded the sin of anachronism by seeking for and 
invariably finding in the life of his subject a source of educational in- 
spiration and wisdom. Only those who have attempted such a study know 
how difficult it is to avoid including a chapter usually entitled “The 
Significance of the Ideas and Work of—for Education Today.” Such a 
chapter can never contain any history; rather it involves a perversion 
of what was originally thought and accomplished in order to fit contem- 
porary problems and needs. It is, of course, inevitable that the selection 
of a subject for biographical study must be inspired by present interest, 
and that this interest will be greatly affected by the state of contem- 
porary education. But the aim of a biographical study should never be 
the solution of an educational problem; it must always be the solution 
of an historical one. 


The adoption of this principle is perhaps the one sure way to avoid 
the final besetting sin of the ‘traditional’ approach to history of educa- 
tion, evangelism, or the desire to popularize through the writing of 
history a contemporary idea or movement in education. If such a con- 
sideration is admitted as a legitimate criterion in the selection and in- 
terpretation of ‘historically significant’ individuals, then the prolifera- 
tion of studies of people who are supposed to have said and done what 
we today find emotionally and intellectually satisfying is likely to con- 
tinue unchecked. The major aim of biographical studies in the history 
of education must be to describe and explain the ideas and work of in- 
dividuals as they affected or throw light upon educational thought and 
practice at that time. Any socially, politically or educationally useful 
results that come about as a result of such studies must be considered 
fortunate by-products. 

Conclusion 


It has been argued that biographical studies are a legitimate source 
of historical understanding and possess a considerable explanatory po- 
tential in the history of education. Due primarily to the parochialism 
of history of education, this potential has not yet been fully realized. 
It is to be hoped, therefore, that historians of education will make a 
determined effort to understand and keep “at the level of explicit con- 
sciousness” those methodological principles which have demonstrated 
their legitimacy and utility within the discipline of history itself. 
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Mathematics Learning and Pupil Characteristics 


The relationships between such pupil characteristics as intellectual 
ability, reading ability, ability to make personal and social adjust- 
ment, conceptual tempo, socio-economic status, and sex, and mathe- 
matics learning in a self-directed (SD), partially teacher-directed 
(PTD) and teacher-directed (TD) setting were examined. In the SD 
setting none of the pupil characteristics considered could be used 
to predict the learning outcomes as measured on a test of initial 
learning and retention. In the PTD setting there existed significant 
relationships between the criterion variables and the following fac- 
tors: intelligence, personal adjustment, social adjustment and _ read- 
ing ability. The learning outcomes for the TD subjects could be pre- 
dicted on the basis of intellectual ability. 


Piaget’s theory of intellectual development describes learning as 
originating from the child and his own interests and drives. The child 
learns from active interaction with his environment and from doing things 
that are interesting to him. He explores, experiments, and modifies his 
behavior and conceptions of the world by means of self-fulfilling drives. 

During the first five or six years of his school-life, concepts such as 
space, time, relations, classes and combinations become available to the 
child. 


...these general concepts are the stuff of general knowledge and intel- 
ligence. These general concepts of the developing intelligence evolve 
whether the child goes to school or not because they are not dependent 
upon specific instruction (Furth, 1970, p. 3). 


Piaget’s theory, when applied to the elementary school, is suggestive 
of certain types of learning atmospheres which, according to various 
authors, would narrow the gap between real life learning and traditional 
school learning. Duckworth (1964), Sullivan (1967), Harrison (1969), 
Biggs and MacLean (1969) and Almy (1968) have made suggestions 
which are applicable to the mathematics classroom in the elementary 
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school. These include: an active involvement by the learner; manipula- 
tion of objects and symbols by the learner; working in a peer group; time 
by the learner to pose questions, experiment, seek his own answers and 
to compare his results with other children. 


Results from various studies seem to suggest that there exist certain 
advantages for young children when they are presented with an approach 
that differs from the expository method. Some advantages of an activity 
or discovery approach include: better learning and retention (Worthen, 
1967); increased fluency in asking questions (Worthen, 1967); high 
motivating power and sustained enthusiasm (Biggs, 1968); willingness 
to tackle new problems, attainment of satisfaction and success (Biggs, 
1968); and minimized discipline problems (Kaye, 1968). Some counter 
claims (Worthen, 1967; Ausubel, 1967) include: an increased expenditure 
of time; possible frustration; unsuited for all learners; and at certain 
age levels understanding is more general, clearer and more precise 
when learned through verbal presentation. 


The variables which have been shown to be positively related to 
mathematics achievement include intelligence (Glennon, 1968), reading 
ability (Glennon, 1968; Romberg, 1969) and _ socio-economic status 
(Glennon, 1968). There appear to be differences between boys and 
girls when mathematical reasoning and computational ability are con- 
sidered (Glennon, 1968). 


Neufeld (1967) points out that there exists some evidence to suggest 
that the relationship. between personality factors and mathematics 
achievement might vary for different instructional methods. Kagan (1963) 
suggests that an individual’s preferred conceptual strategy is implicated 
in a variety of behaviors and Cathcart (1969) found that children classi- 
fied as reflective scored higher on an achievement test than did im- 
pulsive children. 


- Problem 


The major purpose of this study (Liedtke, 1970) was to isolate some 
pupil characteristics which might facilitate learning of mathematics 
and to examine the role of these characteristics in a self-directed (SD), 
a partially peacher-directed (PTD), and a teacher-directed (TD) setting. 


Nuil-Hypotheses 


The purposes stated gave rise to the following null-hypotheses: 

1. For the subjects in the SD (PTD, TD) group there exist no signi- 
ficant correlations between initial learning test scores or retention test 
scores and the following variables: 

a) intellectual ability 

b) reading ability 

c) socio-economic status 

d) ability to make personal adjustment 

e) ability to make social adjustment 
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2. For the subjects in the SD (PTD, TD) group there is no significant 
difference in mean initial learning test scores or retention test scores 
of pupils who are grouped as being: 

a) reflective or impulsive 

b) male or female 


Method 
Treatments, Materials and Samples 


For one of the settings the pupils worked in groups; they solved pro- 
blems and participated in activities without receiving any formal in- 
struction from the teachers. The pupils worked by themselves and the 
teachers’ main task was to be on hand to answer questions or make 
suggestions. Answers for previous tasks were written on the blackboard, 
but checking was voluntary. This setting was labelled Self-Directed (SD). 


For the second, or Partially-Teacher-Directed (PTD) setting, a few 
additional tasks were assigned to the teachers. The topics were formally 
introduced to the subjects in this group. After a brief formal introduc- 
tion which usually included the reading of the answers from the pre- 
vious day’s work, explaining the new tasks for the day, giving some 
examples and assigning the new tasks, the pupils would work in groups 
just as the SD-Subjects did. The teachers were available to assist the 
groups. 

A third, or more formal setting, was mainly Teacher-Directed (TD). 
The teacher supervised the checking of the work and explained the new 
topics to the pupils. The students worked by themselves and assistance 
was given to them by the teacher on an individual basis. 


An activity booklet was prepared which included exercises dealing with 
such topics as decimal fractions, number pairs, co-ordinates, perimeter, 
area, numbers in an array, contour lines, scale, networks, regions, mul- 
tiplication and probability. During a pilot study these topics were pre- 
sented to a group of grade five students to make the items suitable for 
this grade level. The activities for the SD and PTD settings were the 
same, and only a few minor revisions were made for the TD group. 
These alterations included the revision of activities or questions which 
implied working with a partner or as a member of a group. An activity 
booklet was prepared for each of the subjects in the study. 

The design of the study required the participation of different groups 
of students for the three settings. To contro! in some way for the teacher 
variable, groups of students were selected from open-area_ schools. 
Classes of students were combined for the duration of the study and the 
direct influence of any one teacher was limited since he worked with 
another teacher as a team. Since two of the treatments (PTD and TD) 
required the formal introduction of a topic, the teachers took turns 
with this task. 

A request for six grade five classes from open-area schools was made 
to the Edmonton Public School Board. Since the method of teaching or 
presenting the prepared material to the SD group differed somewhat 
from the textbook-oriented mode of teaching mathematics, an attempt 
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was made to obtain a school where such an approach had been used as 
part of the mathematics program. This was considered important since 
the study lasted only four weeks and a completely new approach would 
require a great portion of this time for orientation and familiarization. 
Two schools were included in the study. 


School-l had an open-area as part of the building; however, the 
majority of the classrooms in this school were of the conventional 
type. During the day various classes moved in and out of the instruc- 
tional area. Two grade five classes were located side by side in the open- 
area. Part of their program was group activity oriented and part of their 
mathematics program included activities, games and exercises that were 
not based on any one textbook. These two classes were selected to be 
part of the SD-treatment. 


Two other classes in School-1, whose home area consisted of a con- 
ventional classroom, but who moved into the open-area at the same 
time for part of their instructions, were selected for the PTD-treatment. 
Their past mathematics experience was textbook oriented. 


All the subjects in School-2 were part of the TD-treatment. Some of 
these subjects shared an instructional area with a group of grade four 
pupils; however, for the duration of the study all the subjects worked 
together in one area. In this school mathematics teaching was based 
on the textbook. 


The number of subjects in each of the schools and involved in each 
of the treatments who completed the study, are summarized in Table 1. 
Seven subjects were excluded from the study because they missed more 
than one-fourth of the total number of days during the study, and one 
subject (PTD) was dropped because he failed to complete any of the 
activities or tests assigned to him. Of the eight subjects that were ex- 
cluded from the study, five were from the SD group, two from the PTD 
group and one from the TD group. 


TABLE 1 
DISTRIBUTION OF SUBJECTS FOR THE TREATMENTS 


School Treatment* Boys Girls Total 
1 SD 30 21 db] 
PED 32 21 53 
TD 16 21 Sil 


* SD = Self Directed; PTD =Partially Teacher Directed; TD = Teacher Directed. 


Data Collected 


Several instruments were used to collect the necessary data. While 
the study was in progress, the following group tests were administered 
to the subjects: California Short-Form Test of Mental Maturity (Level 2), 
California Test of Personality (Elementary-Form AA) and the Para- 
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graph Meaning Test of the Stanford Achievement Test—Reading 
(Intermediate I). 


Six items of the Matching Familiar Figures Test (Kagan, 1965) were 
administered individually to each of the subjects. The time taken until 
the first response was given was measured with a stop watch to the 
nearest half-second and a record of each response was kept until the 
correct answer was given. Thus impulsive (fast) and_ reflective(slow) 
students were identified in terms of the time taken by each one to re- 
spond to the various stimuli presented to them and in terms of the 
number of incorrect responses each one gave. A median split on both 
average errors and average time was used to classify the subjects ac- 
cording to conceptual tempo. 


To determine a measure of socio-economic status the father’s occupa- 
tion was obtained from the school records and was matched against the 
occupations listed on Blishen’s revised Occupational Class Scale 
(Blishen, 1964). 


All of the subjects wrote a pretest consisting of twenty multiple choice 
questions which were based on most of the topics presented during the 
study. A criterion test which consisted of thirty multiple choice items 
was constructed and it was administered to the subjects one day after 
the study was completed and again four weeks later to obtain a measure 
of initial learning and retention respectively. The questions of this test 
were based on the material that was presented to the subjects during 
the study. An attempt was made to include different types of questions. 
One part of the test dealt with recall of the material. A second part 
required the subjects to apply some generalizations about the material 
that was presented to them. Another part of the test required the solv- 
ing of problems that were not confined to the operations and solutions 
of problems for which a straight-forward procedure had been presented. 


Results 


The group tests were administered to the subjects during the first 
week of the study and a measure of each subject’s socio-economic status 
was obtained. The means and standard deviations of these tests for the 
three treatment groups are summarized in Table 2. 


TABLE 2 


MEANS AND STANDARD DEVIATIONS OF INTELLIGENCE, READING, AND 
PERSONALITY TEST SCORES AND S.E.S. FOR SD, PTD, AND TD SUBJECTS 


Personal Social 
Group Intelligence Reading S.E.S. Adjustment Adjustment 


ee re a ee oS a a a ane 


SD 106.9 (12.4) 34.5 ( 9.0) 42.0 (10.8) 46.8 (11.0) 49.8 (10.4) 
|g Ud 109.6 (13.5) 39.2 (12.4) 50.3 (14.2) 45.6 (10.9) 49.8 (10.0) 
TD friar o.¥) 44.8( 7.2) 62.4 (13.2) 50.8 ( 9.2) 55.2 (7.9) 


eee ec a 
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Three tests related to the material presented during the study were 
administered to the three treatment groups. The results of these tests 


are listed in Table 3. 


TABLE 3 


TEST RESULTS FOR SD, PTD, AND TD SUBJECTS 


Group Test 


SD Pre 
Initial Learning 
Retention 


Pre 
Initial Learning 
Retention 


PTD 


Pre 
TD Initial Learning 
Retention 


Correlation coefficients (Pearson type) for the variables, 


Standard 

Mean Deviation 
5.96 EE 
11.55 2.83 
12.24 2.83 
6.38 2 
12.34 3.66 
12.66 Ao lL 
Tor 2.91 
15.89 3.66 
17:28 sell 


and the 


criteria were calculated and these are presented in Tables 4, 5 and 6. 


Variable 


— 


. Retention Test 

. Initial Learning Test 

. Intelligence 

. Socio-economic Status 
. Personal Adjustment 
. Social Adjustment 

. Reading 

. Pretest 


ANA nar wh 


Note—Underlined coefficients are significant at .01 level. 


TABLE 4 
INTERCORRELATIONS AMONG VARIABLES AND CRITERIA FOR 
SD SUBJECTS 
1 2 3 4 5 6 fi 8 
1.000 
.642 1.00 
2 eco 0OG 
EO ae L000 
.020 -.083 .197 .057 1.000 
2011 187 292 | 0e0t 45 000 
136 .034 .561 -.115 .345 .485 1.000 
iO3LY C2776 1.154) 106D12.046 Pa aA 000 
intelligence, sacio- 


Since no significant correlations existed between 


economic status, personal adjustment, social adjustment, reading ability, 
and the scores on the initia! learning and retention test for the subjects 
in the SD group, the corresponding null-hypotheses stated were not 


rejected. 


148 


Ser as 


Mathematics Learning 


TABLE 5 
INTERCORRELATIONS AMONG VARIABLES AND CRITERIA FOR 
PTD SUBJECTS 

Variable 1 2 3 4 5 6 7 8 
1. Retention Test 1.000 
2. Initial Learning Test .740 1.000 
3. Intelligence .764 .650 1.000 
4. Socio-economic Status aol ole oto 1.000 
5. Personal Adjustment -043 453 475 .167 1.000 
6. Social Adjustment 641 553 .633 .193 .757 1.000 
7. Reading 742 .623 .802 .237 542 .702 1.000 
8. Pretest 449 .411 .391 .172 .312 [289 314 1.000 


Note—Underlined coefficients are significant at .01 level. 


For the subjects in the PTD group, significant relationships existed 
between intelligence, personal adjustment, social adjustment, reading 
ability and the initial learning and retention test scores. Therefore the 
corresponding null-hypotheses stated were rejected. Since the relation- 
ships between socio-economic status and the two tests scores were not 
significant, the associated null-hypotheses were not rejected. 


TABLE 6 
INTERCORRELATIONS AMONG VARIABLES AND CRITERIA FOR 
TD SUBJECTS 
Variable 1 4 o 4 5 6 7 8 

1. Retention Test 1.000 
2. Initial Learning Test .644 1.000 
3. Intelligence 466 .474 1.000 
4. Socio-economic Status 042 .285 .050 1.000 
5. Personal Adjustment -.078 -.208 -.005 .066 1.000 
6. Social Adjustment 050 .031 .149 -.085 .704 1.000 
7. Reading 424 410 .625 .045 .008 .214 1.000 
8. Pretest 449 479 .378 135 .086 .292 .418 1.000 


Note—Underlined coefficients are significant at .01 level. 


For the TD subjects, correlation coefficients of .466 and .474 between 
intelligence and the retention and initial learning test scores respectively, 
indicate that the pupils of high intelligence scored significantly higher 
on these tests than the pupils of low intelligence. Thus the correspond- 
ing null-hypotheses were rejected. No significant relationships existed 
between socio-economic status, personal adjustment, social adjustment 
and the scores for the two tests. Therefore, the corresponding null- 
hypotheses were not rejected. The relationships between reading scores 
and the initial learning and retention test scores were significant and, 
consequently, the corresponding null-hypotheses were rejected. 
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To test the hypotheses which deal with differences of groups formed 
on the basis of conceptual tempo and sex, t-ratios were calculated. 


Seventeen subjects (8 male, 9 female) in the SD group were classi- 
fied as impulsive and eighteen (11 male, 7 female) as reflective. The 
means for these two groups on the initial learning test were 11.35 and 
12.16 respectively. On the retention test the impulsive group had a mean 
of 12.56; the mean for the reflective group was 12.67. Males in the SD 
group had a mean of 12.13 on the initial learning test, and the mean 
for the females was 10.71. For the retention test the means for the males 
and females were 12.50 and 11.85 respectively. None of the differences 
in means stated above was significant, and therefore the corresponding 
null-hypotheses were not rejected. 


The seventeen (11 male, 6 female) PTD subjects who were classified 
as reflective had a higher mean for the initial learning test (14.00) and 
the retention test (15.82) than the fifteen impulsive subjects (7 male, 
8 female) who had a mean of 11.33 for the initial learning and a mean 
of 10.87 for the retention test. Only the difference in means for the 
retention test was significant: t(calculated) = 3.910; t 01,30 = 2.457, and 
therefore, the appropriate null-hypothesis was rejected. Since there 
existed no significant differences between the means for boys and girls 
on either the initial learning test (male - 12.56, female - 12.00) or the 
retention test (male - 13.13; female - 11.95) the corresponding null-hypo- 
theses were not rejected. 


The means for the fourteen impulsive subjects (9 male, 5 female) in 
the TD group on the initial learning and retention test were 16.14 and 
17.50 respectively. The twelve reflective subjects (2 male, 10 female) had 
means of 16.08 and 17.45 for these tests. The boys had a mean of 15.81 
on the initial learning test and the mean for the girls was 15.86. On the 
retention test the means for boys and the girls were 17.25. None of the 
differences stated above was significant and consequently the cor- 
responding null-hypotheses were not rejected. 


Conclusions and Discussion 


On the basis of the results presented the following conclusions may 
be drawn: 


(a) The non-existent relationship between the variables and the learn- 
ing outcomes for the subjects in the self-directed group suggests that 
changes in role or leadership style of the teacher result in different 
behavior reactions from the pupils. Even such factors as intellectual 
ability may fail to show up as a reliable predictor of the learning out- 
comes in such a setting. 


(b) When a partially teacher-directed setting is used as part of an 
instructional program, some types of learners stand to gain more from 
this procedure than others. In terms of mathematics achievement it 
would appear that students who make personal and social adjustment 


readily and are of high reading ability receive the greatest benefit from 
such a treatment. 
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(c) In a teacher-directed setting the most important of the variables 


studied as a predictor of mathematics achievement is intelligence of 
the child. 


(d) Different levels of verbal interaction between pupils and teachers, 
and pupils and pupils, do not appear to produce differences in 
mathematics achievement between boys and girls. 

(e) A setting which is self-directed will not be disadvantageous for an 
impulsive child. He will learn, for the first few weeks at least, as well 
as the reflective child. 


In a partially teacher-directed setting reflective children tend to ob- 
tain higher scores on an achievement test than impulsive children. 
Reflective children also retain more of the material when it is presen- 
ted in such a setting. 


(f) When independent group work becomes an important part of an 
instructional program, most students appear to adjust easily to such a 
setting. They appear to work eagerly and productively at the tasks pre- 
sented to them. However, an achievement test administered after a 
few weeks of such a program will not be a good indicator of the pro- 
ductivity that seems apparent. 


(g) In terms of learning outcomes, formal instruction given to a 
group as a whole at the beginning of a class session appears to be of 
little value. 


(h) The ability to predict mathematics achievement on the basis of 
prior knowledge appears to depend on the setting in which mathema- 
tics is taught. 

- The results for the SD group seem to indicate that the relationship 
between the variables included in this study and the learning outcomes 
as measured on the test of initial learning is interrelated with the role 
of the teacher. Usually a positive relationship exists between intelligence 
and mathematics achievement. Similar relationships have been found 
between socio-economic status and mathematics achievement and 
between reading ability and mathematics achievement. None of these 
relationships existed for the results collected from this group. It seems 
that when the teachers’ authority and direct influence is removed from 
the tasks to be performed, students who usually experience success fail 
to do so. 

The question, “What kind of learner is best suited for this kind of 
an approach?” could not be answered for the subjects in this sample, 
since none of the variables included in this study were related to the 
measured learning outcomes. It can be suggested that when students are 
introduced to and work in a setting which is self-directed, for the first 
few weeks at least, variables or pupil characteristics other than those 
selected are related to success. If this suggestion is correct, an aware- 
ness of this fact by the classroom teacher could be of importance since 
it may prevent him from drawing wrong conclusions. He should keep in 
mind that when he changes from one teaching strategy to another his 
usually reliable method of predicting success for some of his students 
may no longer be valid. 
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It is interesting to note that no important differences existed between 
the standard deviations of the pretest for the three treatment groups 
(Table 3). However, the results in the same table indicate that the stan- 
dard deviations for the initial learning and retention test were smallest 
for the SD group. This seems to suggest that a self-directed setting may 
perhaps produce a uniformity of performance when mathematics 
achievement is considered. 


When compared to the SD group, the teacher in the PTD group had 
a more direct influence on the subjects and the tasks that were to be 
performed by them. This teacher influence appears to be directly related 
to the abilities to make personal and social adjustment on behalf of the 
students since the learning outcomes for the subjects in this group could 
be predicted on the basis of these two variables. If the abilities to make 
personal and social adjustments are related to success in such a setting, 
how would it be possible to accommodate subjects who lack feelings of 
personal and social security? If it is true that students of high intel- 
lectual and high reading ability receive the greatest benefit from teacher- 
directions, the question of teacher-effectiveness must be raised. It has 
been said that this kind of student will “survive” any method and learn 
no matter what method is used. How then could or should a teacher 
revise his method to be of maximum benefit for the remaining subjects? 


The TD subjects were selected from a different school located in a 
different area of the city. On the basis of the means for the variables 
which were considered in this study, it can be concluded that the sub- 
jects in this group are drawn from a population that is quite different 
than the population for the SD and: the PTD subjects. The positive re- 
lationship that existed between intellectual ability and the initial learn- 
ing and retention test scores for the subjects in this treatment is in 
agreement with the results of many other studies which have reported 
findings on mathematics achievement and intelligence in_ teacher- 
directed settings. It would be interesting to know how such a group 
would fare in a self-directed or partially teacher-directed setting and 
what would be the relationship between the pupil characteristics and the 
learning outcomes. 


Additional studies are required to determine the influence of particu- 
lar learner, teacher, content and environmental characteristics on out- 
comes from different modes of instruction. 
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Development of Some Non-Instructional 
Components of a School System! 


The administrative, auxiliary, and support components of the Edmon- 
ton Public School District were examined from 1944 to 1969. A series 
of ratios were established comparing these components with various 
measures of the size of the school district for this time period. The 
ratios showing the relative growth of the central office administra- 
tive staff, central office auxiliary staff, and central office support 
staff all indicated that the growth of these components have been 
more rapid than the growth of the entire district. Educational trends, 
availability of funds, amalgamation, and staffing policies obviously 
affect the trend of these ratios over time. 


The organization of public elementary and secondary education in 
Canada underwent several major changes during the 1950’s and 1960’s; 
these changes included large increases in enrolment and in the size of 
school jurisdictions. As a result, Canadian public education is now 
controlled by considerably fewer and much larger school districts than 
existed in 1945. 


Organizational theorists are aware that increasing size is usually 
accompanied by increasing complexity. One of the major areas of 
speculation relates to the size and structure of the administrative com- 
ponent as organizations become older and larger (Starbuck, 1965, p. 495). 
Obviously, relationships between individuals and groups become more 
complex, and administrative tasks, such as coordination, become more 
difficult. 

Most of the studies relevant to this area of research have been con- 
ducted in non-educational organizations. One variable which has been 
examined in detail in recent studies, in both educational and non-educa- 
tional organizations, is the “administrative proportion,’ that is, the 


! The special assistance provided by personnel of the Edmonton Public School District is gratefully acknow- 
ledged. 
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ratio between the number of people employed in administrative tasks and 
some measure of organization size. 


A commonly accepted hypothesis concerning organizational growth 
was provided by Parkinson (1957) who maintained that the administra- 
tive proportion grew disproportionately with respect to increases in 
size of the organization ( pp. 15-22). Support for this view has been pro- 
vided by Terrien and Mills (1955, p. 13) in their cross-sectional study of. 
California school districts, and by Gittell and Hollander (1968, p. 58) 
in a study of growth of large city school systems in the U.S.A. between 
1955 and 1965. Terrien and Mills found that the larger school districts 
tended to have larger administrative proportions. Gittell and Hollander 
showed that the administrative proportion of the New York school dis- 
trict doubled over a ten-year period, and that of Detroit rose by a third, 
while those of Baltimore, Chicago, Philadelphia and St. Louis remained 
approximately constant. 


These two studies illustrate different research methodologies used 
in this area of investigation. The cross-sectional technique compares 
characteristics of organizations of different size at one particular time, 
and infers that over time the smaller districts through growth will attain 
characteristics presently possessed by relatively larger districts. Longi- 
tudinal studies are really historical in that they examine actual develop- 
ment of organizational components over time, and do not involve infer- 
ences of the type made in cross-sectional studies. One purpose of this 
article is to outline a research method which has current relevance to 
many school districts. 


Several studies have indicated that an inverse relationship exists be- 
tween administrative growth and total system size, that is, the larger 
systems studied tended to have smaller administrative ratios. Five 
studies conducted since 1967 at The University of Alberta have demon- 
strated that this inverse relationship exists for school systems in the 
four western Canadian provinces. Gill (1967) and Blowers (1969) ex- 
amined administrative ratios in forty-one systems in Manitoba, Saskat- 
chewan, Alberta and British Columbia. Vithayathil (1969) restricted his 
research to 108 Alberta school systems which included most of the pupils 
in the province. These cross-sectional studies counted each administra- 
tor as a full unit, even though some principals may have taught for a 
substantial part of each school day. 


In 1970, a study (Lepatski, 1970) prorated administrative time, 
included ail in-school administrative staff (such as department heads), 
and for the first time in this type of research introduced salaries of 
various classes of personnel as a variable. In this study, adminis- 
trative ratios were examined in the seven major metropolitan areas 
of Winnipeg, Saskatoon, Regina, Edmonton, Calgary, Vancouver and 
Victoria. In addition to these cross-sectional studies, Blowers (1969) 
examined each of these forty-one school districts longitudinally over 
the five-year period from 1964-65 to 1968-69. His findings indicated 
that the administrative ratios increased for some districts, decreased 
for some others, while for a few they stayed approximately constant. 
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A Longitudinal Study of an Urban School District 


A recent study examined the relationship between the growth of ad- 
ministrative components of a school district and the growth of the en- 
tire school district over time. The Edmonton Public School District 
(EPSD) was selected for this study partly because of its relatively 
rapid growth between 1944 and 1969. Some of the findings probably re- 
late to other large school systems; the EPSD is used in this article as 
a vehicle to demonstrate changes, to illustrate methodology, and to 
allow for speculation upon reasons for changes over time. No criti- 
cism of the EPSD is intended in the observations and comments. 


Some of this growth came as a result of its amalgamations with the 
neighbouring school districts of Beverly in 1962 and Jasper Place in 
1964, but in large measure it resulted from rapid increases in the popu- 
lation of the City of Edmonton. The EPSD is responsible for hiring its 
senior officials; the major external effect upon its administrative develop- 
ment may have been various changes in the provincial grant structure 
over the years. 


Personnel files, payroll records, superintendent reports and secretary- 
treasurer reports were used as data sources. From these, the numbers of 
schools, pupils, teachers, principals, and central office staff were ob- 
tained for the period 1944-45 through 1968-69. Incormpleteness of records 
for 1947 required that some estimates were made. Personal interviews 
and examinations of school board minutes helped in ascertaining pre- 
cise job descriptions of many of the central office personnel. The vari- 
ous categorizations were made largely on the basis of the job descrip- 
tions obtained from the above sources. 


Variables 

Numbers of the following components (Table 1 and Figure 1) were 
used as the raw data. 
1. Total Central Office Staff. 

All people who worked in the central office were placed in one of 

three major categories: 

(a) Central Office Administrative Staff (COAd)—included those per- 
sonnel performing administrative functions in the central office, 
i.e., those responsible for making the major decisions in the dis- 
trict, and for overall direction and coordination. To provide further 
detailed information, the COAd was sub-divided into senior, inter- 
mediate, supervisory and service categories. 

(b) Central Office Auxiliary Staff (COAx)—included all personnel 
working either directly with pupils (COAxP, e.g. psychologists), or 
on instructional matters (COAxT, e.g. consultants). 

(ec) Central Office Support Staff (COS)—included all personnel perform- 
ing clerical, secretarial or custodial functions. 

2. Schools. 
Pupils in day-time attendance. 
4. Teachers—included principals. 


= 
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Figure 1. Yearly Changes in Numbers of Central Office Staff, Edmonton Public School 
District, 1944-1969 


5. Principals—equalled number of schools. 
Some of the above variables were also combined to form two new 
variables: 

6. Central Office Professional Staff = COAd + COAx. 

7. Major Administrative Component = COAd + No. of principals. 

Certain ratios were constructed from these variables, and their values 
calculated for each school year. These ratios compared the size of a 
component to a measure of the size of the district. Because of the high 
positive correlation between numbers of teachers, schools and pupils, 
use of only one size measure was necessary. In this article, the number 
of teachers is used, and this is most appropriate because it provides 
comparison of two measures of staff size in the various ratios. For 
example, the ratio 100 COAd:T, as used in this article, refers to the ratio 
of the number of central office administrators per 100 teachers. These 
ratios were then graphed over time for the 1944-69 period, and some 
generalizations developed. Because the growth pattern from year to year 
was fairly regular, the graphs obtained using time along the horizontal 
axis were very similar to those using number of pupils. 
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Limitations 

The available records did not allow inclusion of any in-school adminis- 
trative personnel other than principals. Obviously, inclusion on a pro- 
rated basis of the time spent by vice-principals, department heads and 
others on administrative tasks would produce a more comprehensive pic- 
ture of the administrative component. Further, other variables such as 
complexity can influence staffing ratios, but these were necessarily 
omitted. 


Findings 
Central Office Administrative Staff 


As shown in Figure 1, the absolute size of the COAd grew less 
rapidly than did the central office service component (COS = clerical, 
secretarial and custodial) since 1957. The central office auxiliary com- 
ponent (COAx) also grew more rapidly than the COAd, moving from 
one-sixth of the latter’s size in 1957, to about one-half in 1969. The ratio 
COAd:T declined generally during 1948-1963 from about 0.032 to 0.017, 
but rose rapidly again to reach the level of 0.033 by 1969. All the ratios 
are represented in Table 2, and the comparative growth of the ratios is 
shown in Figure 2. 

Further detailed information was obtained by dividing the COAd into 
the four following categories. 


1. COAd Senior Staff—included the superintendent; deputy, associate, 
and assistant superintendents; and the secretary-treasurer. The general 
trend of the ratio 100 COAdSenior:T was constant from 1944 to 1958, 
being about 0.46, then declining to an average 0.28 in 1960-69. 

2. COAd Intermediate Staff—included all directors, assistant directors, 
assistant secretary-treasurers, administrative assistants and personnel 
officers. The ratio 100COAdIntermediate:T declined from 0.42 in 1948 to 
0.13 in 1959, and rose sharply to 0.76 in 1969. 


3. COAd Supervisory Staff—included all supervisors, assistant super- 
visors and coordinators. The ratio 100COAdIntermediate:T declined from 
about 1.10 in the 1950’s to about 0.82 in the 1960’s. 

4..COAd Service Staff—included all purchase planners, equipment techno- 
logists, and requisition controllers, as well as directors and supervisors 
primarily involved in buildings and maintenance. The ratio 100COAdSer- 
vice:T fluctuated randomly until 1967 when it sharply increased to 1.27, 
and to 1.32 in 1969. 


Central Office Auxiliary Staff 

Since 1944 the ratio 100COAx:T increased fairly steadily from 0.24 to 
1.08 in 1967, and then rose steeply to 1.51 in 1968. 
1. COAx-—Pupil Oriented (COAxP)—included psychologists, social workers, 
speech therapists, remedial clinicians and attendance officers. After 
fluctuating growth from 1944 to 1964, when the ratio 100OCOAxP:T rose 
from 0.24 to 0.51, rapid increases occurred to a value of 1.03 in 1969. 
2. COAx—Teacher Oriented (COAxT)—included all subject consultants. 
Prior to 1956 no such category existed. Since then, the ratio 1OOCOAxT:T 
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TABLE 2 


RATIOS OF CENTRAL OFFICE STAFF COMPONENTS TO TEACHERS, 
EDMONTON PUBLIC SCHOOL DISTRICT, 1944-1969 


100 (COAd)@ 100 (COAxP)> 100 (COAxT)¢ 100 (COS)4 100 (COAd + 


° . 5 = COAx + COS)+ 
Year (Teachers) (Teachers) (Teachers) (Teachers) (Teachers) 
1969 BPA | 1.03 49 5.40 10.19 
1968 2.94 1.04 eT, 5.40 9.85 
1967 3.04 89 19 5.45 9.58 
1966 224 .79 a Ws oie 6.95 
1965 2016 TS aS 3.20 6.26 
1964 L716 51 14 B15 5.56 
1963 uy may) 20 2.76 5.22 
1962 1.78 52 OF 3.41 5.98 
1961 1.95 i av B.20 5.97 
1960 2.04 48 2A 3.36 6.12 
1959 2.03 .40 07 eeu! 6.20 
1958 2:25 et 15 3.82 6.59 
1957 2.66 ts) 08 3.08 6.16 
1956 2.92 38 19 2.92 6.40 
1955 Z4AT 51 —_ 2.67 5.66 
1954 2.51 oa — ak 5.96 
1953 2.63 .26 — 2.89 5.79 
1952 2.83 30 — 2.53 5.66 
1951 2.96 sats) — 2.46 515 
1950 2.99 18 — 3,16 6.33 
1949 2.69 19 —_ aT 5.95 
1948 OLD OT — 2AO 5.46 
1947 240 be — 221 4.86 
1946 2.07 23 — 2.07 4.37 
1945 210 23 — 1.40 Spee 


1944 2.16 .24 _— 1.20 3.60 


a. COAd —central office administrative staff. 
b. COAxP—central office auxiliary staff working directly with pupils, e.g. psychol- 


ogists. 

c. COAxT—central office auxiliary staff working directly with teachers, e.g. psy- 
chologists. 

d. COS -—central office support staff, e.g. secretaries. 


was fairly constant at about 0.17 until 1967, after which it rose steeply 
to 0.47 in 1968 and 0.49 in 1969. 
Central Office Support Staff 

Between 1944 and 1966, the ratio 100COS:T rose from 1.20 to 3.75 
in an oscillating manner, and then increased to 5.45 in 1967. 
Combined Components 


The following combinations of the above components were examined 
to provide additional perspective. 
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1. COAd and COAx = Central Office “Professional” Staff. The ratio 
100(COAd+COAx):T increased slowly from 2.40 in 1944 to 3.20 in 1966, 
and then to 4.78 in 1969. 


2. COAd and COAx and COS = Total Central Office Staff. The ratio 
100(COAd+COAx+COS):T fluctuated between 5.22 and 6.95 in the period 
1950-1966, and then increased to 10.19 by 1969. 


3. COAd and Principals = Major Administrative Component. After a 
general decrease from 10.72 to 7.48 in the 1950’s, the ratio 100(/COAd 
+P):T remained fairly constant at about 6.9. 


Discussion 


When compared with growth of the system, as measured by the 
numbers of teachers, overall decreases were noted in the senior and 
supervisory administrative components. Overall increases were noted 
in the intermediate and service administrative components, in both the 
pupil-oriented' and teacher-oriented administrative components, in the 
support component, and in the total central office component. Some of 
these increases have been more rapid than others, and some large in- 
creases occurred near the end of the twenty-five year period. However, 
without doubt, the relative size of the central office staff has increased, 
raising several questions. 


One question relates to methodology. For the EPSD at least, the con- 
clusion from cross-sectional studies that smaller administrative ratios 
were associated with increasing size was not supported. This provides 
some evidence to view such cross-sectional generalizations rather 
cautiously. Blowers’ study (1969) showed that individual school systems 
had quite variable growth patterns of their administrative ratios, at 
least over a five-year period. 


Apart from the large relative increase in central office support staff, 
the most marked change probably has been in the increase of auxiliary 
personnel who provide specialist assistance to pupils and teachers. Why 
is this so? With broadening of educational functions and services, with 
the offering of more programs, and with societal demands for more 
rapid program innovation, increases in these specialist personnel probably 
has been viewed as essential. One would also hope that the increasing 
wealth of our society would allow for continuance of such growth. The 
differentiation of staff titles and functions (“differentiated staffing”’), 
which is currently in vogue, and which will probably continue to be part 
of the educational enterprise, suggests that school districts should keep 
detailed longitudinal staffing records as part of their institutional re- 
search activity. 

Another question relates to the reasons for the cyclical changes which 
occurred in some graphs of the ratios over time. That is, after increases 
in some ratios they would decrease for some years before again increas- 
ing. Certain suggestions can be offered. Periods of financial restriction 
probably most directly affect the numbers of non-instructional staff. The 
appointment of a new superintendent, and/or other senior administrators, 
with differing staffing ideas from their predecessors, could obviously 
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affect the relative sizes of various staff components. Further, amalgama- 
tion with other school districts can be expected to affect existing staff- 
ing ratios for some time after the actual amalgamation. 


Other factors can also be involved in variations in the proportions of 
staff allocated to particular functions. Some of these may relate to con- 
scious policies, while others may reflect particular needs or changing 
values unrelated to formal policies. For exampie, certain policies may. 
exist concerning the placement of consultative staff in the central 
office and/or schools. Changing needs and values are evidenced by in- 
creasing provision of more auxiliary specialist staff, by growing recog- 
nition that educational administration is a full-time and necessary 
activity for many people in larger school systems and schools, and by 
growth of the desire of teachers to have an increased share in the 
processes of decision-making. 
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The Use of Reading Tests for Entrance 
and Placement Testing in a 
Community College 


The “open door” policy of community colleges is usually associated with 
rigid testing programs intended to provide useful information to coun- 
selors and instructors. The present study was designed to measure 
the effectiveness of the entrance tests as predictions of success at a 
community college. One hundred eighty-nine subjects were randomly 
selected and tested using the Dvorak-Van Wagenen Diagnostic Test 
and the Cooperative English Test. Grades obtained in an English 
course and a final grade point. average were used as criterion mea- 
sures in the regression analysis. Results indicated that the two stan- 
dardized tests used have no value as predictors of success in a junior 
college setting. The only value the testing program might have would 
be as a diagnostic service to individuals requesting guidance. 


Perhaps the most significant concept to emerge in the recent specta- 
cular expansion of post-high school institutions of education is the idea 
of a “comprehensive community college” (Campbell, 1970). The term 
is used in the generic sense and describes an institution which does not 
grant degrees and which is basically oriented to community service; the 
nature of such service is highly dependent on the urban or rural loca- 
tion of the college. 

The promise of a community college is to provide technical and 
related forms of training to students for whom the door to post-secon- 
dary education would otherwise be closed. The policy labelled “open 
door” implies that anyone seeking admission to the college is allowed 
the opportunity to study, regardless of his academic background or 
his demonstrated capabilities. In the past, the result has been a large 
dropout rate among students entering community colleges (Campbell, 
1970; Bate, 1970). To overcome this problem, some community colleges 


165 


H. Janzen & E. Johnston 


provide a rigid testing program which is meant to reconcile student 
aspirations with realistic educational goals. 


In the United States, the American College Testing Program (A.C.T.) 
is attempting to apply its testing program to the community college. 
There is some research evidence that the tests used by the A.C.T. Pro- 
gram cannot be used as valid measures or predictors of success in 
community college settings largely because of the biased sample on 
which the tests have been standardized (Hoyt, 1966, D’Oyley, 1969). In 
particular, Hoyt’s (1966) research clearly indicated that these tests were 
not significant predictors of success in freshman courses at a college. 


The community colleges in Canada are known more as a “teaching 
institution” than as a “teaching and research institution” (D’Oyley, 
1969). It may be for this reason that standardized tests have not been 
developed for junior colleges in Canada. Because of the bias represen- 
ted by the A.C.T. Program, it becomes imperative that more research 
be done to establish reliable and valid instruments for predictive pur- 
poses. 


Problem 


The present study is an attempt to assess the use of certain entrance 
tests as predictors of success in the courses chosen by students. The pro- 
blem is relevant because it assesses not only the predictive value of the 
current tests used, but also provides the counselors some realistic infor- 
mation for use in their guidance program. With the new “open door” 
trend, and combined with it the large scale entrance testing, more re- 
search is needed to improve counselling services and to enable educa- 
tors to make valid statements on the basis of test results. 


Procedures 
Sample 


One hundred eighty-nine subjects entering Mount Royal College, 
Calgary, in 1968 were randomly selected for the study. The sample con- 
sisted of 109 males and 80 females; the mean age was 19.3. 


Instruments 


Of all the entrance tests administered, the following were chosen as 
independent measures for the study: 


1. The Dvorak-Van Wagenen Diagnostic Examination, Form M, Parts 
2 and 3. 


2. The Cooperative English Test, Form IB. 
The Van Wagenen yielded the following nine scales: 


1. Perception of relations 6. Simple details 

2. Vocabulary in context 7. Completing related ideas 
3. Vocabulary in isolation 8. Inferences 

4. Range of information 9. Interpretations 

5. Central thought in reading 
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Similarly, the Cooperative English Test yielded four scales. These scales 
were: 


1. Vocabulary 

2. Level of comprehension 
3. Speed of comprehension 
4. Total reading 


The rationale for choosing these scales as independent measures was 
based on research which supports that measures of reading and writing 
ability provide vital clues to cognitive ability and effectiveness of school 
learning (McMurray, 1964, Samuels, 1967). Furthermore, psycholinguis- 
tic research also indicates that measures of language ability correlate 
significantly with intelligence and achievement grades (Mann, 1944; 
Gleser, 1959; Bernstein, 1961, 1962; Lawton, 1963). 

Salisbury (1936) stated that thinking occurs in a language. It 
is a process of organizing incoming ideas—ideas from reading, listening, 
observing and sense experience. These cognitive processes are clearly 
related to concept formation, and hence, it is argued, should demon- 
strate some correlation with achievement scores (McMurray, 1964). 


Since language ability has been shown to correlate significantly with 
achievement measures, the dependent measures chosen for this research 
were: 

1. Freshman English grades as obtained from the instructors. 

2. First semester grade point averages. 

For the purpose of this study, it was assumed that these criterion 
measures were reliable indicators of the students’ performance. 


Analysis 

Scores obtained from the entrance tests and from the instructors of 
English were submitted to a regression analysis. A procedure similar 
to that of Bottenberg and Ward (1963) was used. For the regression 
analysis the following assumptions were made: 

1. The distributions of the criterion scores were normal. 

2. Each array of the predictor variables had the same overall variance. 

3. The prediction of the criterion from the independent measures was 

linear. 

Multiple linear regression models were constructed and an F-Test used 
to test for significance; the critical level of acceptance was set at the 
.05 level. 


Results 


It seemed evident after examining the correlation matrix that pre- 
diction analysis might be superfluous because of the rather low corre- 
lations obtained between the independent and dependent measures. 
Some significant correlations did occur but only between those variables 
denoted as criterion measures and between some scales on the Reading 
Tests. Logically, these correlations should be statistically significant. 
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The first set of regression models assessed the predictive ability of 
the nine Van Wagenen scales for English grades (see Table 1). As can 
be seen, these scales were not found to be useful as predictors for either 
the males or females. 


TABLE1 


R-SQUARED OBTAINED IN USING NINE VAN WAGENEN SCALES 
TO PREDICT ENGLISH GRADES 


Group N R-Squared F-Ratio 
Female Students 80 .167 1.44 
Male Students 109 .030 43 
Total Group 189 .020 46 


The second set of regression models tested whether the same nine 
scales on the Van Wagenen test would predict grade point average 
significantly different from zero (see Table 2). Again, the results were 
not statistically significant for either male or female subjects; however, 
when the two groups (male-female) were combined, a significant F-value 
was obtained. The needed F-value in the latter case was lowered con- 
siderably because of the size of the sample. 


TABLE 2 


R-SQUARED OBTAINED IN USING NINE VAN WAGENEN SCALES 
TO PREDICT GRADE POINT AVERAGE 


Group N R-Squared F-Ratio 
Female Students 80 224 2.08 
Male Students 109 .126 2.0) 
Total Group 189 .120 oe 


* Significant at the .05 level 


' The results in Table 3 indicate that Cooperative English Test scales 
for the total group can be used as significant predictors of an English 
grade but not as predictors of grade point average (see Table 3). It may 
be that English grades have a higher correlation with the Cooperative 
English Test scales (although not significantly higher) than these same 
scales have with grade point average. This may account for the differ- 
ence in a significant F-value for the criterion measures. 

A final test was made to assess the predictive validity of the English 
grades with grade point average as the criterion. Our hypothesis was 
that this should yield a significant F-value since these two measures are 
significantly correlated both statistically and theoretically. The analysis 
yielded an R-Squared of .471 and an F-ratio of 15.66. This indicates the 
usefulness of English grades for predicting grade point average. This 


latter result seems reasonable and is consistent with findings in the 
literature. 
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TABLE 3 


R-SQUARED OBTAINED IN USING FOUR COOP READING SCALES TO 
PREDICT ENGLISH GRADES AND GRADE POINT AVERAGE FOR TOTAL 


GROUP 
Predictors Criterion R-Squared F-Ratio 
Coop Reading Scales English Grade 043 2.80* 
Coop Reading Scales G.P.A. 036 2.30 


* An F of 2.41 was needed for significance at the .05 level. 


Discussion 


The results of this study clearly confirm Hoyt’s (1966) and D’Oyley’s 
(1969) findings that standardized tests such as the Van Wagenen and 
the Cooperative English Test have little, if any, value as indicators of 
performance in freshman courses at a community college. The low 
correlations obtained between scores on the entrance tests and the 
criterion measures seem to imply that, for this sample at least, not even 
the theoretical relationship expected between measures of language abi- 
lity and achievement grades is supported. 


One can offer several reasons why no statistically significant relation- 
ships were obtained. The most obvious one would be that the sample, 
although randomly selected, did not represent the normal population of 
students entering a junior college. The “open door” policy may attract 
students who show little success on standard achievement tests but 
who, because of a high degree of motivation, may still succeed in the 
college classroom. On the other hand, the reverse may also apply: 
those individuals scoring high on the entrance tests may not be success- 
ful in the classroom achievement tests. Secondly, the standardized 
tests, which report reasonably high reliability coefficients, may not be 
valid for the sample on which the present study was based. This suggests 
that further research is needed to establish local norms for these tests. 
Thirdly, is it possible that grades given to these students are also not 
reliable as an indication of the students’ performance? This is a problem 
not only in community colleges but also in secondary schools and at the 
universities. 

The findings of this study have significance for counselors who wish 
to use test results for predictive or placement purposes. It is obvious 
that blanket statements regarding probable success or failure at a college 
cannot be made solely on the basis of a test score. This is not to say 
that entrance testing should be terminated; the results do support some 
limited use of test scores as predictors of success in a community college. 
Both the Van Wagenen and the Cooperative English Tests have some 
minimal predictive validity, although not as high as may be practically 
useful for counselors. At any rate, counselors and student advisors may 
well use subscale scatter and strengths indicated in the test scores to 
provide some guidance. 
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The goal of future research in community colleges should be set 
in the direction of establishing local norms for entrance tests. Further- 
more, selection of a combination of tests that relate to specific curricula 
or specific programs would be advisable if educators want to make 
meaningful statements to students seeking guidance. 


References 


Bate, W. R. Some thoughts on the prediction model. Paper presented at the 
American Personnel and Guidance Convention, New Orleans, March 1970. 

Bernstein, B. Aspects of language and learning in the genesis of the social pro- 
cess. Journal of Child Psychology and Psychiatry, 1960, 1, 313-324. 

Bernstein, B. Linguistic codes—hesitation phenomena and intelligence. Language and 
Speech, 1962, 5(1), 31-46. 

Bloom, B. S. & Peters, F. R. The use of academic prediction scales. New York: 
Free Press, 1961. 

Bottenberg, R. A. & Ward, J. H. Applied multiple linear regression. U. S. De- 
partment of Commerce, Office of Department Services, 1963. 

Braddock, R. et al. Research in written composition. National Council of Teachers 
of English, Champaign, Illinois, 1963. 

Campbell, G. The community college in Canada. Ottawa, Universities and 
Colleges of Canada, 1970. 

Coutts, H. T. et al. A study of the written composition of a representative sample 
of Alberta grade four and seven pupils. Alberta Journal of Educational Re- 
search, 1955, 1, 5-18. 

D’Oyley, V. Canadian post secondary institutions; a challenge to counsellors? 
Paper read at the Canadian Guidance and Counselling Association Con- 
ference, Edmonton, June 1969. 

Dvorak, A. & Van Wagenen, M. J. Manual of directions for the Dvorak-Van 
Wagenen Diagnostic Examination of Silent Reading Abilities. Minneapolis: 
M. J. Van Wagenen, 1963. 

Educational Testing Service. The Cooperative Tests—manual of directions. 
Princeton, New Jersey: Educational Testing Service, 1951. 

Gleser, G. C. et al. The relationship of sex and intelligence to choice of words: 
A normative study of verbal behaviour. Journal of Clinical Psychology, 1959, 
15), 182-191, 

Hallworth, H. J. & Brebner, A. A system of computer programs. London: British 
Psychological Society, 1967. 

Hoyt, D. P. & Munday, L. Academic description and prediction in junior colleges. 
Iowa: American College Testing Program, 1966. 

Lawton, D. Social class language differences in group discussions. Language and 
Speech, 1964, 7(3), 182-204. 

Mann, M. The quantitative differentiation of samples of written language. 
Psychological Monographs, 1944, 56(2), 41-44. 

McMurray, G. A. The background of thought and language. The Canadian Psy- 
chologist, 1964, 5(1). 3-16. 

Percival, E. The dimensions of ability in English composition. Educational Re- 
view, 1966, 18, (3), 205-212. 


170 


Entrance and Placement Testing 


Regan, J. O. School achievement in rural Alberta. A report on Project 614 of the 
Alberta Advisory Committee on Educational Research, May 1966. 


Salisbury, R. The psychology of composition. English Journal, 1936, 25, 356-366. 


Samuels, J. J. The psychology of language. Review of Educational Research, 
1967, 37(2), 109-119. 


Seibel, D. Testing practices and problems in junior colleges—a survey. Princeton: 
Educational Testing Service, 1966. 


171 


=e aud 
Ss ioivend at nee A 
Hg ae ia 
ne et: 9 Lukvecreadlvs 
ane oa) irri. “ 

is we Rages ad aches ig 
58 obo aaltion ae 


a } 
~\ 
Bly 
) Welei 
: Z, 
* ai. | igre 


anes Gut Prat ; ; 
> Bs ae . os ? 7 
n> Ay peta? Lactate Z 7 


i - a c= 


The Alberta Journal of Educational Research 
Vol. XVII, No. 3, September, 1971 


So AUNT ENYOAL cP EREKINS 
University of Lethbridge 


Learning Spelling Through the Use of 
Electric Typewriters! 


The purpose of this study was to compare the spelling performance 
of grade four students who studied word lists using electric typewriters 
(N=34) with those who studied the same lists by the more conventional 
methods (N=26). The experiment was conducted for ten weeks; each 
weekly list included fifteen words. An analysis of covariance design was 
used with intelligence scores and pre-test spelling results as the co- 
variates. There was no significant difference in spelling performance; 
however, the learning of typing skills emerged as a secondary gain for 
the experimental group. 


Although spelling instruction has been considered a relatively simple 
matter when compared with instruction in such subjects as mathematics 
and sciences, “recurring dissatisfaction with spelling ability indicates 
that attainment of desirable instructional results is not a simple matter” 
(Horn, 1969). According to Shane (1955), the instructional methods used 
in spelling should be based upon: 1) factors conditioning spelling ability; 
2) roles of direct instruction and incidental learning; 3) modes of 
representation; 4) the role of spelling in other curricular areas; 5) utility 
of learning generalizations; and 6) the role of tests. While superior 
intelligence is not a guarantee of superior spelling ability, positive cor- 
relations have been consistently reported between spelling ability and 
intelligence. In light of the influence language factors have for intelli- 
gence scores, this is not surprising (Newton, 1960 and Oswalt, 1962). 


An important factor in the learning of spelling, as in all learning, is 
motivation. Motivation in learning is affected by teacher and student 
attitudes and interest; the level of student motivation; the set to learn 


! Special acknowledgements and thanks are due to the following persons who made this research study 
possible: Dr. O. P. Larson, Superintendent, Lethbridge Public School District; Mr. F. J. Clark, Principal, 
Galbraith School; Mrs. B. Nixon and Mr. Thompson, teachers of the classes involved, and Mrs. Dogterum, 
secretary at Galbraith Elementary School. 
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and remember; work habits; instructional methods and their utiliza- 
tion; and self-confidence. The enthusiastic use of the most efficient in- 
structional methods and the student’s awareness of his progress are pro- 
bably two of the important sources of student interest and motivation 
(Chase, 1949 and Horn, 1967). With these last two concepts, in par- 
ticular, in mind, the investigator decided to conduct an experiment con- 
cerning the teaching of spelling to grade four students using electric 


typewriters which were assumed to be an efficient and effective means — 


of instruction and motivation. 


Purpose of Study 


The primary purpose of the study was to teach spelling not typing. 
Electric typewriters were selected so that grade four students who 
lacked finger strength would find it easier to manipulate the typewriter 
keys. 

A secondary benefit, however, was to have the student use the correct 
finger for the proper key on the typewriter. The student was permitted 
to look at the keyboard while hitting the correct key with the appro- 
priate finger, so it was not to be misconstrued as touch typing. It 
was assumed that when the student later was learning typing, it would not 
be too much of a problem to adjust to touch typing by ceasing to look 
at the keyboard. 


The following research hypothesis concerning the learning of spelling 
by grade four students using electric typewriters was formulated: 


A group of grade four students learning spelling by the 
use of electric typewriters will demonstrate superior 
performance in spelling when compared to a group of 
grade four students learning spelling by the conventional 
method. 


Method 
Sample 


Participants in the experiment were two grade four classes in the 
Galbraith Elementary School, Lethbridge Public School District, Alberta. 
The experimental group consisted of 34 students and the control group 
comprised 26 students. 


Design 


Because the students in the two groups were not matched, the results 
were analyzed using an analysis of covariance with pretest spelling 
scores and intelligence scores as the covariates. The analysis of covariance 
permits statistical rather than experimental control of variables; it 
is one of the most valuable tools of statistical inference. ‘““Much educa- 
tional research can be improved by introducing the analysis of covariance 
after the experiment has been completed (Roscoe, 1969)”, and “the use 


of this more precise analysis which seems highly desirable (Campbell 
and Stanley, 1963).”’ 
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Materials 


After consultation with the two teachers concerned, it was decided 
to compile ten weekly lists of fifteen words each from the prescribed list 
Basic Goals in Spelling Book IV by Kottmeyer (1965). The experiment 
was conducted for ten weeks during the Fall of 1969. From the ten weekly 
word tests, a pretest was developed by randomly selecting two words 
from each weekly list so that the pretest comprised 20 words. A similar 
procedure was followed for constructing the post-test. 


Instructional Procedure—Control Group 


The control group learned their spelling word lists by the conven- 
tional manner of writing them out, pronouncing them, syllabicating, 
using them in sentences which formed a story with a trial test and 
writing a final test on each weekly list of words. 


Instructional Procedure—Experimental Group 


On Monday of each week, the meanings of the fifteen words to be 
studied were discussed by the teacher with the experimental group of 
students. 


Six electric typewriters were located in a separate room which had 
previously been the principal’s office. Six students at a time from the 
experimental group attended 20 minutes of typing each school day on 
the electric typewriters. The students were instructed and supervised 
by the school secretary who was extremely competent and enthusiastic 
about the experiment. 


Mounted on the wall of the typing room were large keyboard diagrams 
showing the students which fingers were to be used on the keys. In 
addition, each student had a small diagram alongside the typewriter. 
To allow for a period of familiarization on the typewriter, the experimen- 
tal group spent five, twenty-minute sessions (a week) on the electric 
typewriter before the experiment commenced. 

At first, the student was required to type the words in pairs, five 
times. Each student had a weekly list of words alongside his type- 
writer. At the secretary-teacher’s suggestion, this procedure was modi- 
fied after four weeks to placing the words in simple sentences. It was 
felt that this was more motivational than the repetitious typing of the 
same word. 


Testing—Regular Progress 

At the end of each week, the control and experimental groups were 
tested by their respective teachers on the fifteen words studied. The 
experimental group (who learned their words on the electric typewriters) 
wrote the tests by hand because only six typewriters were available. 


Testing—Pre and Post 


At the beginning and end of the ten-week experiment, the pretest and 
post-test which consisted of words randomized from the weekly word 
lists were administered to both groups. 
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Results 


Table 1 shows that using the pretest spelling test as a covariate, the 
F value is not significant and therefore there was no differences between 
the experimental and control group in the outcome of their performance 
in spelling. 


TABLE 1 
RESULT OF ANALYSIS OF COVARIANCE FOR EFFECT OF PRESPELLING 


eee ee are Sree aera ee 6 er er ee EE EES RS REE TR EN Ak ee 


Source SS df MS F 
Total 328.82 58 | 
Error (within) 316.35 of Bye 
Treatment (group) 12.47 i 12.47 2.25* | 


ee se Oe a RF SE SEER ET OSE EL TS EES SSS EE eh eS A 


* F value Not Significant 


Using intelligence as the covariate, Table 2 indicates that there is 
still no significant difference on the F value though it is very close to 
being significant. 


TABLE 2 
RESULT OF ANALYSIS OF COVARIANCE FOR EFFECT OF INTELLIGENCE 


Source SS df MS F 
Total 451.18 58 
Error (within) 450.87 Ov 7.90 
Treatment (group) 31 1 Ol 3.96* 


* F value Not Significant 


The hypothesis that grade four students who learn spelling by the 
use of electric typewriters would be more successful than students learn- 
ing by conventional methods was rejected. 


Discussion 


While the results of this study indicate that there was no significant 
difference among the performance of the two groups learning spell- 
ing by two different methods, a definite secondary gain for the experi- 
mental group was the learning of typing skills. Also, the effect that the 
use of electric typewriters had on the motivation of the experimental 
group was considerable, even though it did not result in a superior per- 
formance. 


Although the experimental group spent only twenty minutes per day 
on the electric typewriters, by the end of the ten weeks, several of the 
better students could type a page and a half of double space typing in 
the allotted time with practically no errors. This raises the question of 
whether students begin learning to type soon enough. 
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As far as improving instructional approaches to the teaching of spel- 
ling is concerned, it may be that the best possibility lies in the use of 
computer assisted instruction where the student can be instantaneously 
reinforced for his correct spelling of a word. 
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Effectiveness of Participative Teaching Methods 


A survey was carried out with a sample of European management 
teachers concerning the rated effectiveness of sensitivity training, 
Harvard case method, incident method, abbreviated case method, 
business game, field study trip and management consulting in dif- 
ferent learning domains. The results suggest the hypothesis that most 
of the methods in question can be used for teaching several different 
Skills, yet each method has its peak of effectiveness, its “comparative 
advantage”’ over all others. The methods therefore appear to be com- 
plementary to each other rather than substitutes for each other. 


Problem 


Participative teaching methods are used in management schools in an 
attempt to improve the students’ management skills; however, relative- 
ly little is known about the effectiveness of different methods for de- 
veloping different skills. The purpose of this study was to determine how 
management teachers rated the effectiveness of seven participative teach- 
ing methods on ten criterion variables. In our survey we were guided 
by the theoretical model of Hawrylyshyn (1967) who specified the dif- 
ferential impact of teaching methods on a number of managerial skills 
(p. 31). Figure 1 shows how the different methods presumably peak on 
different skills.) Hawrylyshyn’s model poses only a relation of teaching 
methods and managerial skills, while we designed the study to receive 
also data for the remaining learning domains. 


Procedures 


Sample 

The sample included those management teachers who were members 
of the International University Contact (IUC) as of December, 1969. From 
this group we selected thase who had a full-time teachtng responsibility 
in the following countries: Holland, Belgium} Germany, Spain, Italy, 
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Figure 1. Effectiveness of Participative Teaching Methods 


France, and Switzerland. The questionnaire was sent to 207 teachers; 
55 of these replied. A non-respondent study was not carried out. 


Questionnaire 


The questionnaire consisted of the 20 items related to the following 
10 variables: 


OBS 
SEL 
DIA 
SOL 
DEC 


KNO 
ATT 
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skill of observing-identifying, being aware of problems when 
presented with a situation. 


= skill of selecting-differentiating the relevant from the irrelevant. 
= skill of diagnosing-identifying relationships. 


= skill of formulating solutions-elaborating different courses of 
action. 


= skill of taking decisions, or choosing between different courses 
of action. 

= knowledge or acquisition of business principles and techniques. 

= attitudes toward other people (understanding of others). 


Participative Teaching Methods 


WOR = working with other people. 
MOT = motivation or interest for further study. 
VAL = affect in personal values. 


Each variable was represented in the questionnaire by two items 


The respondents were requested to evaluate the effect of different teach- 
ing methods on each of the 20 items by using a 7-point scale. 


The seven participative teaching methods were briefly described and 


as hand-out given to the teachers. The following methods were to be 
rated: 


iL 


Sensitivity Training: (T-Group Training or Group Dynamics) Sensitivity 
training takes place in a relatively unstructured group in which in- 
dividuals participate as learners. The data for learning is not outside 
these individuals nor remote from their immediate experience within 
the group. 


. Harvard Type Case: 


This is a very lengthy case which also includes data not pertinent to 
the problems. The style is in the form of a running narrative; class 
members and instructors have equal access to the necessary informa- 
tion. 


. The Incident Method: 


A bare incident is reported to the students; the incident as such im- 
plies very little information. But there is other relevant information 
known only to the discussion leader. 


. The Abbreviated Case: 


The abbreviated case includes only data pertinent to the problem. 


. The Business Game (Management Simulation Game): 


The three basic components of a simulation game are an abstraction 
of an economic environment, or a model; a series of rules for 
manipulation of this model, or simulation; and a set of rules which 
govern the activity of the participants in relation to the simulation, 
or game. 


. The Field Study Trip: 


The field study trip is characterized by the following essential elements: 


a) a field study involves a visit of one or more days to one or more 
companies. 

b) the participants must meet the decision-making people in the com- 
pany. 

c) the field trip must be preceded by a well-prepared examination of 
the company in general and the expected problems in particular. 

d) the participants have to report on their studies in the field. 


. The Management Consulting: 


The students or participants are engaged in management consulting 
work for interested companies. This takes place so that the students 
form a task force and work on the spot for an enterprise. Essential 
characteristics of this method are: forming a group, working in the 
field, treating the problem jointly and writing a report. 
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Analyses of Data by Method 


The first analysis of the data thus gathered, consisted in an analysis 
of variance of each method separately. The purpose of this analysis was 
to find out whether the teachers attributed different effects on the ten 
variables within each of the seven methods. 


Figure 2 presents the results obtained with all seven methods, but 
it should be remembered that each analysis is independent from the 
others, i.e. one cannot compare the results obtained within one method 
with those obtained in another. 


Within each method the bracketed variables mean that the differences 
between these variables are not statistically significant at the .05 level. 


Figure 2 can be taken as it is and the interested reader draw his own 
conclusions, depending on his purpose. We shall, for our part, try to see 
whether there is some structure in these results, in order to better under- 
stand the table as a whole. For this we shall extract, for each method, 
the highest and lowest variables (or set of variables) that are statistically 
different. In other words, we shall look at the points or set of points 
of greatest contrast, for each method. 


Sensitivity Training 

The two sets of variables at the low and high end of the scale are 
respectively (KNO — SOL — DIA — DEC — OBS — SEL)and (WOR — 
ATT — VAL). The differences between the variables within each set are 
not statistically significant. The variables in the first, low ranked set 
are all the variables of the problem-solving skills, plus knowledge. On 
the high ranked set we find variables of the personal (VAL) and inter- 
personal type (WOR — ATT). Thus sensitivity training is evaluated as 
affecting more the personal-interpersonal characteristics, than the cog- 
nitive (problem-solving) skills. 


In the Hawrylyshyn model, sensitivity training is represented by 
role playing, which is given a peak effect on the skill of communicat- 
ing with others, and little effect on problem-solving skills. A difficulty 
with this model is that the effects of the method are graphically repre- 
sented by a curve and what would constitute a “large enough” difference 
between two points on this curve, is not specified. If we take any differ- 
ence as being meaningful, then role-playing has no effect at all on ob- 
serving and selecting data, some in diagnosing problem, more in for- 
mulating solutions and even more on deciding. From this, severe, point 
of view, the results obtained are not in accord with the model, since 
the differences between the problem solving skills are not statistically 
significant (c.f. Figure 2). If we take a less severe stand and compare only 
the highest and lowest points of the curve, the results of the survey tally 
with the model. 


Harvard Type Case 


The two contrasting sets are (VAL — ATT — KNO — DEC — MOT) 
and the upper end (DIA — OBS — SOL — SEL). 


The evaluation is nearly exactly the inverse to that given to sensitivity 
with problem-solving skills being more affected than personal-interperson- 
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al characteristics. The problem solving skil! of deciding is however in- 
cluded in the low ranked set. 

In the model, the case method is high in diagnosing and formulating 
solutions, lower in deciding and selecting, and nil in observing. The 
results of the survey do not make any difference between diagnosing, 
solutions, selecting and observing, but all these are different from 
deciding (in general the respondents do not seem willing to make any © 
distinction between the first four mentioned skills). Thus, there is a very 
partial fit between the opinions of teachers and the model. 


The Incident Method 


The results cbtained here do not permit forming two contrasted sets 
of points but a contrast between one point and set. Moreover, this can 
be done in two ways either by taking the lowest variable or the highest 
variable. The alternative maximum contrasts are thus: 

a) VAL v/s SOL — OBS — SEL, or, 

b) VAL— KNO — DEC v/s SEL 


Contrast a) indicates a higher ranking of 3 out of the 5 problem-solving 
skills, compared to a low ranking of a personal characteristic. Contrast b) 
indicates a high ranking or selecting against the personal characteristics 
plus the problem-solving skill of deciding and acquisition of knowledge. 


In the model, the incident method has its peak in selecting data, 
followed by diagnosing, solutions, deciding and observing in that order. 
In our results, deciding is differentiated (lower) from selecting, all other 
differences not being significant. Thus again, a very partial fit is found. 


Abbreviated Case Method 

As for the incident method, two alternatives are possible: 

a) VALv/s OBS — MOT — SOL 

or 

b) VAL— ATT — KNO — DEC v/s SOL 

The contrast between personal characteristic and problem-solving 
skills breaks down here. We find in alternative a) MOT in the high set. 
If. we compare this method to its big brother the Harvard Case, we find 
that the difference (as given to the teachers who filled the questionnaire) 
is in the length of the case. Our respondents seem to be saying that with 
a “small” case as compared to a lengthy one, the motivation to study 
further is as much affected as the problem-solving skills (DEC excepted). 
Notice that we are not saying that motivation is higher in the abbreviated 
case method as compared to the Harvard Case, since in this analyses we 
cannot compare a variable between two methods. 


No distinction in the model is made among different kinds of cases. 
The Business Game 

The contrast here is 

VAL — ATT — MOT v/s SEL — WOR — DIA — DEC 


The contrast between personal and problem-solving skills is apparent. 
The variable WOR, working with others is however in the high ranked 
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set, thus denoting the specific character of the business game which is 
always a competition between teams. It is interesting to note that the 
other interpersonal variable, attitudes toward others (ATT) is in the con- 
trasted set to that which includes WOR. Thus the respondents consider 
that the business game affects working with others, but does not affect 
as much the “understanding” or the attitude toward others. 

In the model, the business game has its peak in deciding and com- 
municating with others, followed by solutions, diagnosing, selecting 
and observing. Deciding and diagnosing are different from solutions, the 
other differences not being significant (c.f. Figure 2). Thus only partial 
support is again present for the model. 


The Field Study 

The contrasted sets are: 

DEC — WOR — SOL v/s OBS —- KNO — MOT 

The field study is considered more a method for receiving input 
(OBS — KNO) and increasing the interest of the student (MOT) than for 
attaining the skills of deciding and proposing solutions, or for team 
work. 

In the model, the peak for field study is in observing, followed by 
selecting data, diagnosing, solutions and deciding. The results in Figure 2 
show that observing is different from solutions and deciding. The fit 
here is distinctly better than with the other methods. 


Management Consulting 
Only two points are contrasted in the answers obtained: 
KNO v/s SEL 
It should be noted however (c.f. Figure 2) that all the variables in 
this method are ranked very high, with very little dispersion between 
them. 
Management consulting is not included as such in the model. 


Summary of First Analysis 

As an overall statement on the first analysis, we can say that the 
rated variables are well differentiated among themselves, in two 
methods, sensitivity training and Harvard Case, and that the contrast is 
between personal-interpersonal characteristics and problem-solving 
skills (with the order reversed between the two methods). The differences 
between variables is nearly nil in the case of management consulting, with 
all the variables however rated very high. 

In the remaining four methods, the contrast between personal-inter- 
personal characteristics and problem-solving skills is not as clear cut 
(but is however there) and other specific aspects appear (i.e. belong to 
the “wrong” set of variables): motivation of students in the field study 
and the abbreviated case, team work in the business game. 

A further and last point should be noted: the skill of “deciding” is 
included in the set of problem-solving skills only in the sensitivity train- 
ing and the business game methods. In the other methods, when DEC 
appears, it does not belong to the problem-solving set. 
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Regarding the fit between the obtained results and the Hawrylyshyn 
model, it is rather feeble in all cases, if we consider all the points of 
the curves in the model as being “significantly” different. If we consider 
only the peaks, then the opinions of the teachers are quite in accord 
with the model. 


Analyses of Data by Variables 


The same data have been analyzed in another way, by carrying out 
an independent variance analysis on each of the ten variables, taking 
each time the seven methods together. In this way, we can appreciate 
how the respondents compare the effects of the seven methods on any 
given variables (see Figure 3). 


As in Figure 2, the brackets signify that the methods included in the 
brackets are not statistically different at the .05 level of significance. 
For example, concerning the variable KNO (knowledge), management 
consulting, business game, field study and Harvard Case are not rated 
differently. 


The following comments can be made concerning this table: 


—in only one out of the ten variables, we find no differences between 
the seven methods, namely motivation. Thus, this variable is seen as 
being equally affected by all seven methods. 

—management consulting is consistently ranked at the top (or next to) 
in all ten variables without exception. 

—for two variables, attitudes and values, the seven methods separate 
into two clusters without overlap. 

—management consulting, the Harvard Case and the business game 
are rated close together (are not significantly different) on all the 
variables, except two: attitudes and values. 

—similarly, sensitivity training, the incident method and the field study 
are close together on all variables except three: attitudes, values and 
working with others. 

—management consulting and the Harvard Case are significantly 
different from sensitivity training and field study on four of the 
problem-solving skills. On the fifth one—deciding—management 
consulting and the business game are significantly different from 
sensitivity training, field study, the incident method and the abbre- 
viated case. 


Regarding the Hawrylyshyn model, the results obtained do not 
concord very well with the hypotheses. 

For observing, the model postulates that the field study is very high, 
the other methods (case, incident, business game, and role play) being 


very low. Reference to Figure 3 shows no agreement with such a hypo- 
thesis. 


Similarly, for selecting data, where the model postulates that the 
incident method and field study are high, the other methods are low. 
For diagnosing, the case and the incident method are high, the other 


methods low. In our results, only the hypothesis concerning the case 
method is borne out. 
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For solutions, the case is postulated as being high, nearly as high 
as the business game; the incident method, role play and field study 
being lower. Here there is a good fit between the survey results and the 
model. . 

For deciding, the business game and role play are high, the other 
methods are low. The results confirm only the results obtained for the 
business game. 


Thus on the whole the results and the model agree for the skill of 


formulating solutions, very partially for diagnosing and deciding, and 
not at all for observing and selecting. 


Comments on Both Analyses 


The main conclusion to be drawn from both these analyses is that 
management consulting, the Harvard Case and the business game are 
rated as being more efficient than the other methods, for training on 
the problem-solving skills of observing, selecting, diagnosing, pro- 
posing solutions and deciding. When personal characteristics and atti- 
tudes toward others are to be affected, the preferred methods are sensi- 
tivity training and management consulting. 


A word of caution is in order: the highly consistent rank given to 
management consulting (apparent also in Figure 2) suggests that there 
may be a halo affect concerning this method. That is to say, manage- 
ment consulting being highly praised (for other reasons) is given indis- 
criminately high effects on all variables. We doubt whether manage- 
ment consuiting has all the virtues that it is given; for one thing it must 
not represent a very high proportion of a management student time and 
its “replication” must be very difficult (is in fact impossible). The halo 
may be due to the fact that it represents a “real” thing not just an exer- 
cise as in the other methods (except perhaps field study and sensitivity 
training, which is always felt by the majority of participants as a very 
real affair and not just an exercise) and that there is a commitment, 
usually of a financial nature. That management consulting may be a 
good educational tool is not denied, on the contrary. What is doubted is 
the kind of panacea that is attributed to’it—it has drawbacks due to its 
rarity and non-replication. 


Theoretical Considerations 


A more general and theoretical comment applicable to all methods 
(including these not represented in our sample of seven) is that any 
method of teaching, like Esop’s tongues, can be the best or worst method. 
It depends on the way that it is handled. This of course does not mean 
that we consider all methods equally effective for any purpose: the 
business game, for example, does have a time element in it, a press for 
taking a risk and feedback on the effects of this risk, that is largely 
lacking in the other methods. Our comment does mean that over and 
above the specific effects claimed for any one method, there exists an 
effect due to the way the method is handled. 
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A better way of expressing what we have in mind is that the specific 
effects of a method are or become operative (or do not) according to the 
way the method is used. To take the business game as an example again, 
this method purports to develop the understanding of the many factors 
that operate in an organization, and to teach the participants to take 
calculated (and productive) risks (these among other objectives). How- 
ever, it is not an absurd thought to imagine that an individual in such a 
situation (and the way it is handled by the instructor) gets even more 
confused and learns not to take any risk at all. What we say about the 
business game can also be applied to any method. We do not have any 
“data” to support what we are saying and it should be taken as a general 
hypothesis about the effectiveness of any teaching method. We say 
general hypothesis because to become a scientific (testable, operatively) 
hypothesis it should be formulated in more specific ways, and for each 
method the operating variables will not be necessarily the same. 

Sketched very roughly, the procedure will be, for any given method, 
the following: 


a) detail all the objectives or effects that are claimed for the method, 

b) choose one or more of these objectives for investigation (e.g. 
understanding complex operations, willingness to take calculated 
risks), 

c) find ways of evaluating, even roughly the chosen objectives, 

d) detail the conditions (or processes) that may impair or improve the 
the attainment of the objectives (e.g. stressful conditions may im- 
pair the willingness to take risks), 

e) set up an experiment in which a chosen condition is present for 
some groups and absent for others, and evaluate the attainment of 
the objectives of all groups. 


It can be appreciated how this processes called research can become 
‘heavy, involved and complicated, when a large number of objectives 
and of conditions are present, and this is always the case. 


The practicing instructor cannot obviously carry out such a process. 
But he can try to operate in a way that would give him the maximum 
chances to develop his educational action. That is to say he may try to 
achieve the same end that one hopes to get from research results: find 
out the factors that affect (positively and negatively) the teaching- 
learning process. Although the procedure to be presently described cannot 
be dubbed scientific research, it has the advantage that it can be tried 
by any willing teacher. The procedure is the following: 


a) detail to the students the different objectives that one intends to 
achieve with a given method (or a given course), 

b) discuss with the students these objectives, so that additions, 
omissions, modifications of the initial list become possible on a “ra- 
tional” basis (the inverted commas signify that all what is said is 
not necessarily rational and that what is not said is not necessarily 
irrational... ), 

c) detail the methods or conditions that one intends to use for attain- 
ing the objectives, 
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d) as in b), discuss these methods, 

e) go ahead, 

f) periodically (once a week?) ascertain by discussion (group or in- 

dividual or both) how far the set objectives have been attained, and 

what is much more important, the reasons why they have been (or 

have not) attained, 

proceeding from f), either continue or readjust the firing (the first 

possibility is very unlikely and should even be taken as a signal © 

that something has gone wrong somewhere... ), 

h) continue the whole process until the maximum satisfaction of both 
teacher and learner are attained. 


_— 


g 


This process is nothing more than a reformulation of a feedback loop 
with student participation. Conceptually, it is a very simple idea (goal- 
action—appraisal of result—regoal), but it is difficult to operate in 
practice. 


The main drawback for the operation of this procedure is that the 
teacher does not trust enough the student and trusts too much himself. 
For this process to operate the teacher must have at the same time and 
integrated in his self, a big dose of self-confidence and of self-doubt. 
Otherwise, he will not be able to listen, non-defensively, to what the 
students say, and distortions, omissions and non-perception will occur. 


A second, but minor condition for the operation of this procedure, is 
that the number of students must not be too big. This difficulty can, 
however, be easily obviated by dividing the class into small groups 
(3 to 5). 


To sum up, the participation methods currently used in management 
schools, may have special strengths and weaknesses, as described for 
example in the Hawrylyshyn model. Research in this matter is being 
pursued and will eventually clarify the factors operating in specific teach- 
ing methods.! 
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A Comment on “‘A Soviet and Western 
Concept of Set” 


EDITOR’S NOTE. One of the functions served by the publication of 
research results is that it permits the scholarly examination and cri- 
ticism of interpretations. No doubt such examination takes place with 
respect to most studies which are reported; however, it is seldom that 
comments and reactions are set down on paper. For this reason we 
are pleased to be able to publish a comment by Mr. Burnett on “A 
Soviet and Western Concept of Set,” which appeared in the December, 
1970 issue of AJER, together with a reply by the authors. 


Hritzuk and Janzen (1970) have examined the concept of set from two 
different viewpoints: the Soviet concept ustanovka, identified with the 
psychologist Uznadze and the Western concept Einstellung, developed 
by Luchins. 

The method consisted of having a group of subjects take three tasks: 
Luchins’ Hidden Word Test, a “three sphere” test (haptic), and a “four 
circles” test (visual), the latter two tests being related to the Soviet 
concept. 

The article states, “The hypothesis tested was that no significant dif- 
ferences exist between the observed and expected frequencies on excita- 
tion (of set) and extinction trials between the Western and Soviet test 
results (p. 221).”” The proper formula for the chi-square statistic to test 
this hypothesis is given in Ferguson (p. 206) as 

Ay 
ee AT) 

where the A and D represent the two cells with different categories 
(i.e. the two set - no set cells or the two extinction - no extinction cells). 
This formula is used to provide a statistical test for the difference be- 
tween two proportions based on the same sample of individuals. Thus 
the paired observations may exhibit a correlation that must be taken 
into account. 
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Using this formula the data from the first four tables were reanalysed. 


Table 1: Examining the marginal totals, Luchins’ “set” contained 32 
subjects whereas the haptic modality “set” had 47 subjects. 
The statistical significance of this difference may be examined 
using the above formula, resulting in a value of chi-square of 
11.84 which is significant at the 0.01. level. Therefore the null 
hypothesis of no significant differences between the proportions 
is rejected. 

Table 2: Lunchins’ “set” contained 31 subjects (Table 1 reported this 
value as 32?) and the visual modality “set” had 38 subjects. 
The value of chi-square = 1.96, not significant at the 0.01 
level. Therefore in this case the null hypothesis of no signifi- 
cant differences between the proportions is accepted. 


Table 3: Luchins’ “extinction” had 3 subjects, the haptic modality 
“extinction” had 36 subjects; chi-square = 33.0, significant 
at the 0.01 level. 


Table 4: Luchins’ “extinction” had 3 subjects, the visual modality 
“extinction” had 30 subjects; chi-square = 22.09, significant 
at the 0.01 level. 


Three of the four analyses do not support the authors’ conclusion that 
the two concepts of set are similar. These new results are in agree- 
ment with a “common-sense” review of the marginal totals—the data 
from the tasks are quite different. 


The chi-square statistic used by the authors in Tables 3 and 4 may 
be varified to be 


N (AD - BC)? 


Tn a (Ferguson, p. 204) 
(A + B\(C + D)(A + C)(B + D) 


This formula provises a test for a different hypothesis, namely: “There 
is a zero relationship (i.e. independence) between the observed and ex- 
pected frequencies”. Since the values of chi-square that were computed 
using this formula were both non-significant, this hypothesis would be 
accepted. 

This writer was unable to determine the formula used to compute 
the chi-square values reported in Tables 1 and 2. However if one were 
to use the above formula of chi-square for testing independence, values 
for the chi-square statistic of 0.30 and 0.52 are obtained for Tables 1 
and 2 respectively. That is, the results of these analyses also indicate 
acceptance of the null hypothesis that the two concepts of set are in- 
dependent. 


In Reply to J. Dale Burnett 


With regard to the calculations used for testing hypotheses in “A 
Soviet and Western Concept of Set”, the basic formula used was: 
xa (tt sealant) LE? 
pea Kj 
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where Oj; is equal to the observed number of cases categorized in the 
ith row of the jth column and Ej; is equal to the number of cases ex- 
pected under H, to be categorized in the ith row of the jth column. 
The value of X? yielded by this method has (r - 1) (k - 1) degrees 
of freedom. Keeping our purpose, assumptions and procedures in mind, 
we felt this approach would give us the desired statistical results. When 
the results were recalculated, there were only very minor differences. 


Originally we took different samples, cross matched them, tested them 
on individual tasks of extinction and/or excitation on the two theoreti- 
cal approaches. We considered the results in 2 x 3 tables, then combined 
categories into a 2 x 2 table. We found no statistical differences in the 
results. We originally planned to report all the tables in 2 x 3 form, 
for example Extinction, No Extinction as well as Extinction, Weak Ex- 
tinction and No Extinction. This is how the original results were cal- 
culated and recorded. 


One realizes that the use of parametric statistics may be of more 
value in a problem of this nature. We reanalyzed our results using the 
number of trials as our dependent variable; the results of the analyses 
led us to believe the performances on the tasks were very similar. It is 
very difficult to debate assumptions, and we really do not believe there 
is some absolute right or wrong. For example, we see a “trial” as some- 
thing rather discrete but others will argue that it can very easily be 
interpreted on the interval scale of measurement. It’s probably what one 
can live with best. 


In terms of interpretation, we had in mind the idea that groups may 
or may not differ with respect to the characteristics under investigation 
and therefore with respect to the relative frequency with which group 
members fall in several categories. In this case, we wanted to see whether 
individuals differed in the frequency with which they extinguish or ex- 
cite a set in relation to their performance on the Luchins test. The hypo- 
thesis as stated in the article may not be too clearly written. The dif- 
ficulty as we see it lies in the interpretation of the obtained results. One 
could look at whether the theoretical and observed frequencies could 
occur by chance as well as the observations taken on subjects as being 
dependent or independent of each other. We interpreted (correctly or 
incorrectly) the results as no difference in the performance on the ex- 
tinction or excitation tasks, and related this to the independency between 
Luchins’ and Uznadze’s tests. We used a goodness of fit (or a test of 
independence). The formula that Burnett quotes: 


N (AD - BC)? 
(A + BYXC + D(A + C)(B + D) 


is statistically equivalent to the one (in a 2 x 2 table only) we used, to 
the one outlined in the beginning. However, the test is not whether the 
theoretical and observed frequencies could occur by chance but that the 
observations we took on the subjects were independent or dependent of 
each other. In actual fact, the way we explained our results we inter- 
preted them with the latter view in mind, namely, that Luchins’ and 


X2= (p. 204, Ferguson) 
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Uznadze’s tests are independent, i.e. measuring different aspects 
theoretically. 


The problem was in the interpretation; we mistook the direction of 
our prediction. Accepting the null hypothesis for our chi-square tests meant 
that the tests were really independent. In other words, Luchins and 
Uznadze are really measuring different domains. We interpreted it as 
meaning that they were associated tests, measuring the same elements. 


As far as looking at marginal totals, Burnett is quite correct that 
differences are obvious. However, we are sure that Burnett is aware that 
with small samples marginal totals can be quite deceiving. Unfortunately, 
in our case, the marginal totals did show significant differences but not 
as we postulated. An error occurred in our interpretation and we 
appreciate Burnett’s critical examination. It appears that Uznadze’s tests 
and Luchins’ tests are not equivalent. This, in fact, makes more sense 
to us and agrees with our original hypotheses regarding the theory of 
set. We appreciate the analysis Burnett offered. The interpretation 
occurred as a result of confusing two different research projects being 
analyzed simultaneously; no deliberate attempt to distort the results was 
made. 


John Hritzuk 


Henry L. Janzen 
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BOOK REVIEWS 


CONTEMPORARY INFLUENCES IN EARLY CHILDHOOD EDUCATION 


By Ellis D. Evans, Toronto: Holt, Rinehart and Winston, 1971. 366 pp. 
$7.65. 


It is rare to find an author who can interpret research in an objec- 
tive, readable manner; however, Ellis D. Evans has done just that in his 
latest book, Contemporary Influences in Early Childhood Education. 
This book centers around some of the latest research into programs for 
young children. These programs vary from the highly structured ap- 
proach of Bereiter and Engelmann to the integrated-individualized approach 
utilized in the British infant schools. 


The chapter topics are as follows: (1) Psychology and Early Child- 
hood Education: A Brief Perspective; (2) The Montessori Method; (3) 
Project Head Start and Follow Through; (4) Structural Pedagogy for 
Language Development; (5) Behavior Analysis Procedures; (6) Piagetian 
Influences; (7) The British Infant School Movement and Miscellaneous 
Programs; and (8) Major Issues Revisited. Each chapter ends with a 
list of useful references related to the program which was discussed. 
The book concludes with three appendices which include a description 
of frequently used tests, thoughts about school readiness, and a list of 
preprimary programs. The latter is the most useful as it is composed 
of program names, directors, authors, and addresses. A comprehensive 
index is included in the final section of the book. 


The strength of Contemporary Influences in Early Childhood Educa- 
tion lies in the review of research. Evans presents a wide variety of 
research about each program under discussion, and he includes both 
the pros and the cons of the research. For example, in the chapter on 
“Project Headstart and Follow Through” a brief history of the project 
is given followed by a discussion of the purpose and objectives of head- 
start. As was pointed out, the program was conceived originally as a 
multidisciplinary approach made up of seven components: education, 
medical-dental care, nutrition, social services, psychological services, 
parent education, and the involvement of community volunteers. Various 
programs have grown out of this format, and Evans identifies three 
types: those that are predominantly social, those that are organized 
around pre-academic activities, and those that are “highly specialized 
in function and detailed strategies are devised to counteract the de- 
pressing effects of the child’s early environment.” Evans says that the 
third type of program is rare, although there is a move in support of 
“direct instruction.” 


Two types of studies, descriptive and evaluative, have been used in 
the evaluation of headstart programs. The most extensive study to date 
was the evaluative study carried out by Westinghouse Learning Cor- 
poration and Ohio University which Evans describes briefly. He also 
describes two Follow Through programs: The New Nursery School and 
the Tucson Early Education Model (TEEM). The New Nursery School 
deviates from the conventional nurseries in that a considerable amount 
of hardware is used. Activities in the New Nursery School center around 
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a tutoring booth, a typewriter and the Language Master. The Tucson 
project is more child-centered; activities are self-selected and interest 
centers are utilized as well as field trips and cooking activities. 


The weakest sections of Contemporary Influences in Early Child- 
hood Education are the chapters entitled “Structural Pedagogy for 
Language Development” and “Behavior Analysis Procedures” in that 
the research is not as inclusive as in other chapters. Evans describes in 
great detail the language programs developed by Carl Bereiter and Seig- 
fried Engelmann. However, he concentrates mainly on the positive 
research and neglects to point out some fundamental criticisms like 


“teaching for the test” as has happened in some instances. As for the © 


description of behavior analysis, it is done in a very clear and simple 
manner—but over and over again. The reviewer began to get the feel- 
ing that she was being conditioned. 


The chapter titled “The British Infant Schools Movement and Mis- 
cellaneous Programs” is well done but is not as extensive as it might 
have been. More could have been said about the “new” British Infant 
Schools because some interesting approaches are developing which 
cannot be evaluated by standardized tests. An in-depth approach could 
have been more effectively utilized in the description of the “new” in- 
fant school concept and its influence on education. 


Evans also could have written more about programs designed to en- 
hance a child’s self-concept. He did cite some interesting research being 
done in this area, such as that described in Besell and Palomare’s 
book, Human Development Program, but he could have expanded upon 
this program or the related research. 


One very important influence in education today that Evans failed 
to mention relates to commercially produced programs. Many programs 
are developed and then “packaged and sold” to the schools, such as 
the one developed by Bereiter and Engelmann. In spite of such ommis- 
sions, Contemporary Influences in Early Childhood Education is a valu- 
able reference or a suitable text for a course in program design in early 
childhood education; it will be especially useful to educators interested 
in programs for young children and the influence of such programs on 
early childhood education. The book is a unique addition to the ever 
increasing amount of material being written about the subject of early 
childhood education. 


JANIS BLAKEY 
The University of Alberta 


THE FOUNDATIONS OF MODERN EDUCATION 


By Elmer H. Wilds and Kenneth V. Lottich, New York: Holt, Rinehart 
and Winston, Fourth Edition, 1970. 590 pp. 


In their study of educational theory “from the day of primitive man 
to the present age,” Professors Wilds and Lottich attempt “not only to 
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relate the history of education with corresponding social movements but 
also to illustrate the significance of contemporary accomplishments and 
their adjacent problems.” The task is not an easy one for the very com- 
plexity of history necessitates the selection and delimitation of material. 


Those expecting an in-depth description and explanation of historical 
events will be disappointed as the text is a survey in twenty-one 
chapters highlighting a variety of educational landmarks. The first four 
chapters outline educational developments from the tribal to the early 
Judaic period, including a study of oriental conceptions of education. 
Chapters five to eleven examine educational change in Roman, Medieval 
and Reformation Periods, while twelve to seventeen center on the in- 
vestigation of later European thought. The last four chapters provide a 
cursory study of some of the more recent changes in American and “in- 
ternational” education. 


“By tracing the influence of changing social, political, economic, and 
religious views upon the development of educational thought,” the 
authors seek to “provide a sound basis for the reinterpretation and evalua- 
tion of present-day theories and routines.” The difficulty in conducting 
such a survey is one that is common to any coverage of an extended 
time period. On the one hand, there is a danger of excessive generaliza- 
tion and oversimplification which may minimize the significance -of 
particular events. On the other, there is a possibility of including a host 
of historical minutiae not suited to the expectations of a survey. There 
appears to be some evidence of such a dilemma, particularly in the in- 
terpretation of medieval scholastic thought. 


This problem, however, is overcome in part by a technique that sub- 
divides each chapter according to educational (1) aims, (2) types, 
(3) content, (4) agencies, (5) organization, and (6) methods. The value 
of this classification is that the authors are able to combine a discus- 
sion of particular educational theorists with the social movements of 
which they are a part while maintaining the original purpose of the 
book. Though the schema is somewhat repetitious, it provides a ready 
reference to the salient features of a given era. Not to be overlooked 
is the listing of secondary as well as some primary source materials at 
the end of each chapter which suggest useful background reading to 
the topics under discussion. 

Whether or not the text achieves its purpose depends, it would seem, 
upon the cognitive perspective one takes to the nature and purpose of 
educational history. At best, any attempt to illustrate the connection 
between historical events and the present is made difficult by the great 
number of variables bearing upon any given situation. The authors have 
met this challenge in a defensible survey that has a place in introductory 
studies. Moreover, it should provoke other interpretations and assist in 
the understanding of educational problems past and present. 


HENRY W. HODYSH 
The University of Alberta 
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HELPING AND HUMAN RELATIONS: A PRIMER FOR LAY AND 
PROFESSIONAL HELPERS. 


Volume 1, Selection and Training; Volume 2, Practise and Research. 
By Robert R. Carkhuff. New York: Holt, Rinehart and Winston, 1969. 


In the past few decades the criteria for success in the education pro- 
fessions have changed rather drastically. The counsellor is no longer 
viewed in terms of dispensing information and pigeon-holing clients. 
Also, the image of the good teacher is no longer closely associated 
with discipline, classroom decorum and the imparting of information. On 
the other hand, success is increasingly being viewed in terms of ability 
to relate and communicate. Carkhuff in the aforementioned books 
suggests that ability to communicate in a helpful manner is a skill and 
that it can be acquired; thus dispelling the often held notion that it is 
innate and immutable. In his recent two volume edition he purports to 
provide the basic cookbook. In a series of propositions and corollaries, 
human relationship variables are spelled out with a precision that is 
analogous to the physical sciences. In addition, selection procedures for 
prospective helpers are suggested and training procedures are discussed. 
Carkhuff has written his texts not only for the traditional helpers—social 
workers, counsellors, teachers and other professionals in the area of 
human relations—but also for lay persons concerned with effective help- 
ing. He emphasizes however, that they are designed to be used “under 
the guidance of an experienced professional; one who is equipped to 
handle all modes of practise and inquiry”. 


In the two volumes, Carkhuff has attempted to operationalize what he 
considers to be the critical phases of effective human relations. These 
he globally refers to as the core facilitative and the action oriented 
phases or dimensions. The facilitative phase refers to the ability to 
let the helper know he is being understood and respected. The action 
oriented dimension refers to the application of specific techniques and 
knowledge in order to provide maximal help. Carkhuff’s position is very 
clearly defined, and he has managed to bring together approaches which 
have previously been viewed as widely divergent, into an integrated 
package. 


In the first volume, Carkhuff presents his basic model and also pro- 
vides a distinct set of measurement guidelines for discriminating what is 
facilitative and what is deteriorative. The focus is then on effective 
selection and training procedures based on these criteria. In the second 
volume the emphasis is on applications of his model to specific situa- 
tions. Approaches to behaviour change are presented along with, in 
many instances, actual case materials. Topics are presented in a very 
specific manner (i.e. Training Parents to Work with Their Disturbed 
Children) and consequently have potential for direct application. In 
addition, arguments are presented for translating knowledge and skills 
concerning the helping relationship into later social action projects. 


In conclusion, it is the feeling of the reviewers that Carkhuff has 
made a major contribution to both theory and practise in the helping 
professions. At the same time, it is imperative that the reader exercise 
his powers of discrimination. Carkhuff’s approach is deductive with 
sometimes questionable assumptions forming the building blocks for 
subsequent corollaries and propositions. Wherever possible Carkhuff 
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cites research to support his arguments. This research however, is 
usually by himself and/or his collaborators or colleagues. His writing 
style is emphatic which may lull the reader into feeling that all of the 
long sought after answers relating to the helping process have finally 
been found. It should be realized that Carkhuff himself emphasizes that 
his position is tentative and subject to change with new evidence. These 
final comments have not been intended to detract the reader from the 
books but to encourage him to keep an open mind and avoid wholesale 
acceptance of books Carkhuff himself calls “‘primers’’. 


D. DONALD SAWATZKY 
and 


KATHY CORMIE 
The University of Alberta 
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The University of Alberta 


RESEARCH AND DEVELOPMENT IN EDUCATION 
— THE HRRC EXPERIENCE — 


Although educational research in Alberta has a history which spans 
several decades, it was only with the creation of the Human Resources 
Research Council in 1967 that the possibility for concerted research and 
development activities in education became a reality. In the past few years, 
HRRC has added a significant new dimension to research in education 
which complements the work carried out through the efforts of individual 
scholars, the universities, the Alberta Advisory Committee for Educational 


Studies, professional associations, school districts, and other agencies. It ° 


would probably not be unfair to previously existing efforts and agencies 
to state that HRRC has both added to the research capability as well as 
stimulated educational research within the Province. The major purpose 
of this theme issue of AJER is to bring some of the results of HRRC’s 
experiences with research and development activities to the attention of 
our readers. 


The intent of this issue is not just to inform; it is also to share learn- 
ings. The experience of a new organization in launching activities which 
involve researchers, administrators, policy makers, teachers, and the public 
in new types of relationships hold many lessons — lessons for those who 
have yet to become involved in similar activities as well as for those who 
are already engaged in research and development. Although the projects 
described in this issue have not yet been completed — and one is still in 
the “embryonic” stage — the persons most closely associated with them 
have consented to share their experiences and tentative impressions. 
AJER is grateful to the contributors for taking on the task of prepar- 
ing reports which are all the more difficult to present because of the 
particular timing. 


The seven articles in this issue focus in one way or another on a 
number of problem areas: organizing for research and development, 
initiating specific projects, managing programs, evaluating research and 
development projects, and placing such activities within a social research 
framework. In the first article E. J. Ingram outlines some operational 
principles and the substantive focus of HRRC’s programs in education; 
he also discusses some general organizational problems. Although J. O. 
Fritz refers specifically to the development phase of one mission (Hu- 
manization of Learning), both W. G. Roberts and F. D. Oliva also give 
attention to design and development in their discussions of Project 
SEARCH and the IPI Project respectively. The Roberts and Oliva articles 
also present insights into approaches and problems associated with the 
management of specific projects. L. W. West and T. O. Maguire address 
themselves to the evaluation of these same projects and, in this con- 
text, raise some general issues in the evaluation of research and develop- 
ment activities. In the concluding article, L. W. Downey examines the 
current situation of social research in general and suggests some new 
directions as well as needed developments. 


These articles summarize activities which involved extensive con- 
ceptualization and planning, implementation work, and re-conceptualiza- 
tion. We trust that our readers will find both the descriptions of the 
projects and the insights which they have yielded to be valuable additions 
to the Canadian literature on research and development in education. 


E. Miklos 
Editor 


The Alberta Journal of Educational Research 
Vol. XVII, No. 4, December, 1971 


E.J.INGRAM 


Associate Director 
Human Resources Research Council 


HRRC’s Research and Development 
Programs in Education 


HRRC was created “. . . to undertake educational, social, economic, and 
other research relating to and affecting the development and conservation 
of human resources in Alberta.” The principles of complementarity, mis- 
sion-orientation, and systematic management were adopted to guide the 
selection and conduct of HRRC’s programs. The educational programs 
focus on the personalization of teaching and learning, and the planning 
and decision making processes. Several problems resulting from the wide 
range of expectations held for HRRC and the difficulties of designing and 
conducting mission-oriented programs have arisen. These problems are 
gradually being solved as the organization gains experience in planning 
and conducting mission-oriented research. A major set of problems present- 
ly receiving the attention of HRRC centers around the role of research 
and development in educational improvement. Of primary concern is the 
development of appropriate conceptual and operational linkages among the 
functions of policy making, policy research, planning, research and develop- 
ment, dissemination, and the implementation of policy and plans. 


The Human Resources Research Council was created by an Act of the 
Alberta Legislature in March, 1967 “. . . to undertake educational, social, 
economic and other research relating to and affecting the development 
and conservation of human resources in Alberta... (An Act to Establish 
The Alberta Human Resources Research Council).”” Emphasis was placed 
upon the facilitation and coordination of research efforts within the pro- 
vince; the development, revision, assessment and dissemination of plans, 
materials and procedures relating to human resource development; the 
training of persons engaged in human resources research; the undertaking 
of developmental studies in education; and the creation of a general 
public awareness of human resource problems and needs. 

HRRC planners and policy makers faced a series of difficult tasks in 
coming to grips with the mandate and in selecting the initial substantive 
focus for its research programs. Because HRRC’s mandate covers all types 
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of research which relate to human resources development, its approaches 
and structures were developed to accommodate this total field of con- 
cern. This article, however, is limited to a description and analysis of 
HRRC’s Research and Development program in education, which was the 
major initial focus of the Council. 


Operational Principles 


The focus of the initial educational program undertaken by HRRC 
was sharpened through the application of three principles which emerged 
from a study of R and D programs conducted elsewhere and from the 
early experience of HRRC itself. These were the principle of comple- 
mentarity, the principle of mission orientation, and the principle of sys- 
tematic management. 


The Principle of Complementarity 


Educational R and D was introduced into the United States by means 
of a large number of fragmented, overlapping and uncoordinated pro- 
grams undertaken by numerous universities, school systems and research 
agencies (Chase, 1968). Dissatisfaction with the results of this approach 
led the U.S. government to take steps to bring more order into educational 
improvement programs. The establishment of the Research and Develop- 
ment Center program, the Regional Educational Laboratory program, and 
the National Institute for Education represent in large measure the ef- 
forts of the U.S. government to bring coordination and complementarity 
of effort into educational improvement activities in that country. In 
general, the Centers concentrate on problem-oriented research whereas 
the Laboratories concentrate on the development and dissemination of 
instructional systems or other educational products. The National In- 
stitute for Education has a mandate to coordinate and give leadership to 
all programs designed to improve education (Marland, 1971). 


The Act establishing HRRC makes it abundantly clear that duplication 
of research should be avoided and that coordination of programs should 
be attempted. This principle of complementarity was observed in HRRC’s 
education program in four major ways — research presently underway in 
Alberta was not duplicated by HRRC, research which could be conducted 
as well or better by some other agency was not undertaken by HRRC, 
programs were undertaken in cooperation with other groups, and wherever 
possible the research abilities of personnel in other organizations were 
used by HRRC. 


Mission Orientation 


Following the American decision in the 1950’s to support education 
as an instrument of national policy in international affairs, increased 
attention was given to the effectiveness and efficiency of educational im- 
provement programs in furthering American policy (Boyan and Mason, 
1968). It soon became evident that the gap between ‘knowledge produc- 
tion” and “knowledge utilization” in education was just as great, if not 
greater, than it was in other social service delivery systems. It also be- 
came evident that educational improvement efforts, in addition to being 
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limited, were fragmented and lacked clear direction. Many programs also 
lacked adequate conceptual, operational and evaluative designs. 


A search for more adequate programs resulted in a rapid acceleration 
of the R and D approach to educational improvement. Although the role 
of R and D in medicine, agriculture, physical science, industry and na- 
tional defense was well established early in the 1950’s, an interest in the 
application of R and D to education did not become evident until the mid- 
1950’s. The initial R and D concepts in education were based on the 
standard business and industrial model which contain three sub-models: 
fundamental research, applied research, and development. 


Fundamental research is primarily concerned with the search for scientific 
knowledge with little regard for the application of this knowledge to the 
generation of a specific useful product. However, the results of this type 
of research usually serve as the fountainhead for future scientific and engi- 
neering endeavor in the evolution of useful products. Applied research 
combines, refines, and extends the results of fundamental research to obtain 
practical technology which will serve a useful purpose or generate a useful 
product. In the latter case, applied research often results in the design of 
a prototype device or process. Developmental research is concerned with 
the refinement of applied research results and the integration of these with 
production and processing methods which will most efficiently and economi- 
cally generate the product for market. (Jackson and Spurlock, 1966, pp. 
21-22). 


Educational researchers were familiar with fundamental and applied 
research; however, they approached developmental research with caution. 
Consequently, until recently, developmental research has been given short 
shrift in most R and D programs. Because the initial models were divided 
into two components — research and development — the Research and 
Development institutions tended to emphasize either one or the other, 
with most selecting research for their major emphasis. The R and D center 
program in the United States, for example, tended to emphasize the re- 
search side of the continuum. Subsequently the regional educational 
laboratory program was initiated to help balance the scales; however, 
fragmentation still remained. A fully integrated approach to R and D was 
difficult to achieve and conflicts and jealousies between researchers and 
developers began to develop. A similar situation developed in the Ontario 
Institute for Studies in Education where, initially, responsibility for re- 
search and development were delegated to two separate offices. 

These early experiences with Research and Development programs led 
to modifications in the original R and D concept. The systems approach, 
where education is viewed as a system of interrelated parts affected by 
its environment, found a home in the R and D movement after it was 
realized that there was not a simple linear flow from basic research to 
development as was suggested by the industrial model. The systems model 
tends to blur the distinction between R and D and integrates both types 
of activities into systematic problem-oriented or “mission-oriented” in- 
quiry. 

The “mission-oriented” approach! adopted for HRRC’s education pro- 


1 The term “mission-orientation” was borrowed from the American space program. 
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grams consists of several integrating concepts. The research programs 
are to have clear social purposes and well defined goals which can be 
achieved over specified time periods. Each program is to be based on 
a sound conceptual rationale and a defensible research and evaluation 
design. The interdisciplinary approach to investigating social problems 
is also an important element in “mission-oriented” inquiry. 

Following clarification of the concept of mission-orientation, HRRC’s 
education projects were consolidated and reformulated to meet the 
specifications of the concept. 


The Principle of Systematic Management 


A major criticism of the uncoordinated, fragmented, overlapping 
approach to educational research is that it has a minimal impact on 
policy and practice. This can be explained in part by the lack of an ade- 
quate problem or mission-orientation. However, inadequate planning 
and management systems, both for individual projects and for the total 
educational improvement movement, have also resulted in inefficiencies 
and disappointing results. According to Chase (1971) the shortage of 
personnel with R and D management ability, and inadequate planning 
and coordination of programs are major problems in most R and D or- 
ganizations and in the total educational improvement movement. This 
need for more sophisticated planning and management systems became 
obvious as larger and more complex programs were initiated. 


At an early stage in its development the Educational Studies area of 
HRRC decided to establish a research management and coordination 
system geared to maximize the effectiveness and efficiency of its program. 


Identification of Needs. The first component of this management sys- 
tem is an Education Advisory Committee made up of representatives from 
all major educational organizations in Alberta. This committee has three 
major terms of reference — to advise HRRC on areas of needed research 
in Alberta; to review HRRC’s educational R and D programs from the 
point of view of relevance to provincial needs; and to act as a liaison 
mechanism between HRRC and the educational community. Although 
HRRC receives inputs and feedback from many sources, the Education 
Advisory Committee is certainly one of the major ones. 


Mission Planning. After an area of research is tentatively decided upon, 
a general proposal is called for. In many cases, this proposal is prepared 
by the person or persons suggesting the idea. In other cases, it is prepared 
by HRRC staff, if possible, in collaboration with those who might be asked 
to conduct the project. The proposal format calls for an elaboration of 
the mission’s rationale, objectives, end-products, target dates, evaluation 
plans, operational and research design, management system, and budget. 


Mission Management and Control. Following approval of the mission 
proposal, the budget is established and a mission head named. In most 
Cases, mission heads are seconded from other agencies on either a part- 
time or a full-time basis. Mission heads are responsible for the conduct 
of their programs and for the staff of their programs. They have consid- 
erable autonomy to conduct the mission within the terms of their con- 
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tracts, the goals, design and budget of the project and the general polices 
of HRRC; however, modifications in the goals and budget, and major 
modification in design require the approval of HRRC. Staff and consul- 
tants are appointed by HRRC on recommendation of the mission head. 

Each mission head is required to submit quarterly reports to HRRC. 
These reports contain three basic sections: progress since last report, 
quarterly expenditures and estimates for the next quarter, and recom- 
mendations for modifications in design or budget. There is also consider- 
able face to face communication between HRRC’s management staff and 
mission heads during the life of a mission. 


Program Coordination. In order to facilitate the coordination of educa- 
tion programs and to improve the management and research procedures, 
an R and D Review Board, consisting of all mission heads and senior 
research staff, has been established. Through this mechanism, mission 
heads are kept informed of other missions, are able to subject their pro- 
grams to critical review by other members of the Board, and are able to 
discuss common problems with one another. 


Mission Products. The reports of missions are reviewed by HRRC staff 
and outside reviewers for four major purposes — to determine the quality 
of the product; to determine forms of publication and dissemination; to 
consider policy implications; and, where appropriate, to integrate the 
products of the various missions. 

The production of printed reports is only one form of dissemination 
and probably not the most effective one for R and D products. There- 
fore, HRRC has instituted a program to disseminate its products through 
conferences, seminars, clinics, and short courses. Whenever possible 
these are conducted by, or in cooperation with, other agencies. 


Substantive Focus of R and D Programs 


Following an intensive period of analysis which took place after clarifi- 
cation of the operating principles outlined above (complementarity, 
mission-orientation, and systematic management), a two-dimensional pro- 
gram focus was adopted. One of these dimensions focuses on the sub- 
stance of the research to be undertaken. The other dimension focuses 
on the type of research to be undertaken (e.g., curiosity-oriented research 
or mission-oriented research). 

The subject matter of HRRC’s educational research programs is divided 
into two categories. The first focuses on what might be called “the per- 
sonalization of teaching and learning.” This collection of programs, which 
is concerned primarily with instructional procedures and the organization 
of schools for instruction, has as its overriding concern the individual 
human being. It addresses questions related to the development of in- 
dividuality in a variety of ways. 

During the last few years there has been a ground swell of public 
opinion, especially among the young, demanding that the importance of 
the individual and the dignity of mankind be the central focus for all 
educational and social deveiopment programs. Educators are also begin- 
ning to concern themselves with this problem. Therefore, the nature of 


207 


E. J. Ingram 


individuality and the development of programs aimed at fostering in- 
dividuality were selected as a major program area. Of particular con- 
cern is the development of individuality in such terms as capacity for 
self-direction and the willingness and ability to assume social responsibility. 


The second substantive focus is on the “planning and decision-making 
process”. It was decided that attention to this concern was essential if 
progress in the improvement of education was to be made. The con- | 
stellation of planning and decision-making concerns centers around pro- 
cesses and mechanisms for future forecasting; for rationally determining 
goals; for initiating, developing and discovering alternative means of 
moving toward these goals; for selecting the most efficient, effective and 
appropriate alternatives for trial; for implementing the alternatives select- 
ed; for monitoring and evaluating the operations in terms of the goals 
of the program; and for correcting the procedures, operations, and ob- 
jectives on the bases of appropriate and relevant feedback. 

Although the basic and applied research which is generally conducted 
in universities is essential to the long-term improvement of education, 
the major focus of HRRC’s educational studies is on what is called 
mission-oriented research and development. This decision is a direct 
application of the principle of complementarity. In other words, HRRC’s 
major interest is in developing and testing products, processes, educa- 
tional methods, and policy alternatives which have real relevance and 
meaning to practitioners and policy makers. 

HRRC is also prepared to assist practitioners and policy makers develop 
the knowledge and skiils necessary to facilitate the effective and efficient 
planning and operation of educational systems. Therefore, HRRC works 
very closely with school systems, schools, teachers and other educational 
decision makers. 

Figure 1 depicts HRRC’s major research and development programs 
in education as they relate to the two-dimensional program focus. 
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Figure 1. Education Programs of HRRC: A two-dimensional Focus. 
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An Assessment 


Whenever a new sub-system is introduced into an existing system, 
the functioning of the total system is disrupted and a period of unrest 
exists until the new sub-system is either rejected or until new roles and 
relationships are established. This disruption is more intense when the 
roles of the new sub-system and its relationships with the existing sys- 
tem are not clearly defined and understood. 

In 1969 HRRC found itself in the position of a new sub-system with 
vaguely defined roles and unclear patterns of relationships with the 
educational system into which it was injected. As a result several problems 
developed. 


Role Expectations 


Should HRRC serve the specific needs and interests of the provin- 
cial government through policy and institutional research? Some think it 
should. Should HRRC serve the research interests of university depart- 
ments and individual professors by acting as a funding agency? Some 
think it should. Should HRRC concentrate on the specific problems 
identified by schools and school systems? Some think it should. Should 
HRRC emphasize basic research? Policy research? Developmental 
research? Dissemination? Various groups and individuals answer in the 
affirmative to each of these questions. Should HRRC conduct its own 
research program or should its major role be to coordinate research being 
conducted by other agencies? Each of these opinions is held by different 
groups. In its educational programs HRRC is attempting to serve all of 
these interests, to some extent at least. However, it has not been able 
to serve any of them to the extent expected by its various user groups. 


HRRC does not believe that its major role is to serve directly the im- 
mediate interests and needs of any group, including the provincial govern- 
ment. Although HRRC accepts the role of attending to some of these needs, 
its major role must be that of taking a broader and a deeper perspective 
on the policy and research problems of the province. This position does 
not imply that the immediate needs and interests of specific organizations 
and agencies are not important or vital to the overall needs of the pro- 
vince. However, if a research organization such as HRRC were to devote 
most of its attention and resources to these immediate needs, the over- 
all result could well be a fragmented and uncoordinated approach to 
social research in the province. 


As described above, HRRC, in its educational programs, has identified, 
through various means — inputs from educational groups, advisory com- 
mittees, the educational literature, expressed concerns of governments 
and input from lay groups — two or three areas of needed research and 
development. It is attacking these areas through a broad missions ap- 
proach which includes cooperative activities with other agencies. This 
approach certainly limits the scope of HRRC’s educational research, 
especially in light of severely limited budgets, and consequently leaves 
many high priority areas unattended. This situation, as could be expected, 
has led to some criticism of HRRC; however, HRRC believes that in the 
intermediate and long-range future, the missions approach to educational 
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and social problems will produce the best pay-off for the people of 
Alberta. 

The immediate needs and problems of educational agencies within 
the province, however, have not been left entirely unattended. HRRC 
has undertaken to conduct this type of research in various ways. It has 
contracted to do specific research projects for the Alberta Teachers’ 


Association, the Alberta School Trustees’ Association, the Department of — 


Education and the Colleges Commission. It is also working cooperatively 
with other institutions in the province on areas of immediate concern to 
these organizations. 


Role Conflicts 

In addition to the problems resulting from the varied role expectations 
for HRRC, problems of role conflict have also arisen. In its develop- 
mental and dissemination programs, is HRRC usurping the role of the 
Department of Education and school systems? Some believe it is. Is 
HRRC’s decision to conduct its own research and development programs 
and to second university personnel to work on these programs, rather 
than emphasizing grants-in-aid and commissioned research, usurping the 
role of the universities and diverting research funds to itself that should 
properly go to universities? Some believe it is. 

HRRC believes its strategy to mount and manage mission-oriented 
programs and to use research talent wherever it may be found will pro- 
duce the highest pay-off for education. However, many of the problems 
of role conflict and interorganizational relationships remain to be re- 
solved. 


Research Management 


HRRC’s educational studies program consists primarily of research 
and development projects conducted through the missions approach. 
Because this approach is relatively new and untried in education, several 
problems have been encountered. 


One set of problems centers around the identification of research pro- 
grams to be undertaken — especially how research areas are identified 
and by whom. Traditionally, research problems have been identified by 
the researcher himself, or by a client who contracts a researcher to con- 
duct a specific study. HRRC has used inputs from researchers, users, 
Council, Council staff and the literature, to determine the research areas 
to which it would devote attention; however, no elaborate model for 
identifying the research needs has been used. This has created many 
problems and some criticism of HRRC. 

HRRC is presently developing a more sophisticated model for identify- 
ing research needs. This model, which is being developed through the 
Human Resources Review project will be used in conjunction with more 
traditional methods to identify areas in need of research. 

Researchers generally determine for themselves the research in which 
they will become involved. Therefore, HRRC anticipated difficulty in find- 
ing researchers prepared to work on projects identified by others. How- 
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ever, very little difficulty has been encountered in this regard, especially 
in HRRC’s educational research program. 

A second set of research management problems centers around the 
development of mission proposals following the selection of a research 
area. Who should prepare the proposal? To what extent should the 
mission goals, procedures, budget, operational and evaluation designs, and 
time deadlines be specified? How elaborate should the management pro- 
cedures be? HRRC has pressed for rather elaborate and specific designs 
for most of its projects and missions; however, because mission manage- 
ment is a new field, some problems have been encountered. At times 
it is difficult to involve potential mission staff in the development of the 
mission proposal. This can lead to conflicts between mission staff and 
the developers of the mission proposal regarding interpretation of intent, 
design, procedures and the like. When the mission head, and preferably 
the staff, is involved at an early stage in developing the proposal many 
of these problems are avoided. 


Another set of management problems encountered by HRRC centers 
around ways and means of staffing its programs. Two methods are used 
to obtain project staff: secondments from other institutions and short- 
term employment contracts. Because of the difficulty of obtaining senior 
researchers on a short-term employment contract, HRRC seconds most of 
its mission heads and evaluators from universities or other institutions. 
Although this procedure serves well the interests of HRRC, difficulties 
have been encountered in obtaining sufficient staff for a large enough 
portion of their time from the universities. Some university staff members 
seconded to HRRC on a one-half time or more than a one-half time bases 
have had difficulties in retaining an identity with their home institutions 
and in having their secondments renewed for another year. If satisfactory 
arrangements cannot be made with the universities to solve this problem, 
HRRC will be forced to find alternative means of staffing many of its 
research projects. 

Traditionally, researchers have either worked alone on _ research 
projects or in a collegial relationship with one or two other researchers. 
This type of arrangement has not produced satisfactory results in large 
scale projects. The scope and complexity of most mission-oriented pro- 
grams makes it necessary for a different management system, different 
role definitions and different relationships to be established. This has 
raised problems of role conflict, involvement in decision making, academic 
freedom and the like. However, as researchers gain experience with these 
new procedures, fewer and fewer problems are arising. 

Another management problem relates to budgeting for large-scale 
mission-oriented programs. Traditionally, the provincial government has 
budgeted one year at a time. This tradition has created serious problems 
for HRRC because many of its programs are planned to continue for a 
three or four year period. Although budget requirements for these pro- 
grams are known for this total period of time, budget allocations have 
seldom been based upon the budgetary needs or estimates of on-going 
programs. 

Some problems have been encountered in budget control within pro- 
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jects; however, most of these have resulted from lack of experience in 
controlling budgets for mission programs. As HRRC gains experience with 
these procedures, fewer and fewer problems arise. 


The Place of R and D in Educational Improvement 


Although HRRC has faced a number of problems created by the varied 
expectations held by its user groups and by the structures and procedures | 
for mission research management, an emerging set of problems, which 
will probably be more difficult to overcome, centers around the role of 
R and D in educational improvement programs. 


The research and development movement in education, which literally 
mushroomed in the United States during the 1960’s, was viewed by many 
educators as a panacea to the problem of moving research into practice. 
However, by 1970, this rapidly rising spiral of expenditures and confi- 
dence in the R and D movement came to an abrupt halt, temporarily at 
least. Although the restrictions which the U.S. government placed on 
expenditures affected all research, its major impact was on social research, 
including education. A basic reason for the restriction of funds seemed to 
be the disillusionment on the part of some policy makers and critics with 
the effectiveness of R and D in solving educational problems. The critics 
claim that there is little evidence that R and D programs have had a 
visible impact on educational practices and policy; many of them would 
abandon the R and D movement and start afresh with new structures and 
new approaches. This has certainly been our tradition in the educational 
improvement movement. R and D was a “glamour” concept in the 1960’s. 
It did not perform miracles immediately so new glamour concepts began 
to emerge — future forecasting, policy research, and second generation 
planning. 

The supporters claim that the R and D movement has had several 
successes. Many new materials, facilities, and procedures have been in- 
troduced as a result of R and D programs. New insights into the pro- 
cesses of planned change in education have emerged. New structures 
and methods of improving education have come about because of ex- 
periences with R and D programs, and the pool of research and develop- 
ment personnel has been greatly expanded (Chase, 1971). 


In any case the R and D movement has certainly not produced the 
dramatic results expected of it. One of the major reasons for this has un- 
doubtedly been the unrealistic expectations held for the approach. Another 
reason is that insufficient time has been given for R and D to prove itself. 
In business and industry it can take several years to make even a small 
impact in a narrow field. However, a more basic reason is the lack of 
adequate linkages between policy making, policy research, planning, re- 
search and development, dissemination and implementation. Improved 
conceptual and operational models are needed to bring about effective 
linkages among these functions. Future forecasting, policy research, and 
planning procedures must also be developed to at least the same degree 
of sophistication that R and D has now reached, if the systems approach 
to educational improvement is to be effective. These high priority tasks 
are now being undertaken by HRRC. 
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Project SEARCH: Experiential Learning 
About the Development Process 


When the resources of a research organization, a relatively small educational 
system, and two rural communities are brought together in a collaborative 
attempt to improve educational opportunity and programs, what might be 
expected to happen? This article outlines some of the significant events to 
date in the two-year history of a project which has produced attempts to 
(1) individualize instructional programs, (2) utilize film making in the 
teaching of English, (3) make driver training readily available, and (4) 
strengthen the bonds between the school and the community. Attention is 
drawn to some of the problem areas and difficulties that have confronted 
the many persons involved in the project. Though the project will not be 
terminated until August, 1972, some general observations and suggestions 
relative to the design and implementation of development projects are 


offered. 


Project SEARCH has meant, and continues to mean, something dif- 
ferent for the different people who have been and are currectly involved. 
For the professional educators, it has meant a unique opportunity to design 
and test modes of instructional practice which promise something better 
for their students. For the lay persons, it has meant an opportunity to 
explore ways and means of developing new and more functional relation- 
ships between the school and the community. For many, it has meant 
an increased opportunity to be involved in the decision-making process 
relative to the local educational enterprise. For the Project staff, it has 
meant an opportunity to assess the operational requirements for a develop- 
mental undertaking of some magnitude. For most, it has meant coping 
with a challenge demanding of time and energy — one which has pro- 
duced periods of extreme frustration as well as moments of genuine 
satisfaction. Above all, Project SEARCH has meant an opportunity to be 
a part of an endeavor fashioned to improve the educational opportunities 
for rural youth. 
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Dimensions of SEARCH 


SEARCH is an Alberta Human Resources Research Council (HRRC) 
sponsored development project which had its genesis in January, 1969, 
when a decision was made to launch the “Rural High Schools Project” 
as the first major undertaking in an activity realm designated as ‘“Pro- 
gram 500: Demonstration and Field Testing.’ The objectives set out for 
the project, sometimes referred to as Project 501, were: 


1. To field test in an Alberta school system a number of innovations 
which aim at improving the educational opportunities of students attending 
small high schools. These innovations include self-instruction systems and 
certain instructional innovations embodied in the multi-campus high school 
concept. 

2. To refine and modify these innovations to meet local circumstances, 
with a view to recommending their ultimate adoption (Alberta Human 
Resources Research Council, 1968). 


Changes in the organizational structure and personnel of HRRC during 
the next two months resulted in a significant shift in the proposed pro- 
ject’s focus as is indicated by the following statement of objectives. These 
revised objectives, and their concomitant anticipated outcomes, were issued 
in mid-March, 1969, and became the guidelines for all subsequent 
activity. 


Objective No. 1 


To develop procedures for increasing the capacity of rural com- 
munities to expand the educational opportunities available to, and 
improve the educational programs provided for, rural youth of high 
school age. 


Expected Outcome No. 1. A_ significant increase in the number 
of school and community members who have achieved and/or 
strengthened problem-solving’ skills, interpersonal skills of re- 
lating, and skills of inner-personal learning. 


Expected Outcome No. 2. An improvement in the _ operational 
_ skills of the community and school groups and task forces in- 
volved in the project. These skills are those that relate to 
problem-solving, group process and self-renewal. 


Objective No. 2 


To increase the number of viable program alternatives readily 
available to Alberta’s youth by field testing in an Alberta setting 
one or more innovations designed to improve educational  op- 
portunities for rural youths of high school age. 


Objective No. 3 


To improve the educational opportunities and improve the _ educa- 
tional programs available to youths of high school age in the. co- 
operating communities. 


Expected Outcome No. 3. A greater variety of educational programs 
available to the high school students in the participating communities 
at the conclusion of the program than there was prior to its initiation. 
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Expected Outcome No. 4. Most of the innovations adopted during this 
project will improve the educational program (in terms of the ob- 
jectives selected) for high school students in the participating com- 
munities. 


Expected Outcome No. 5. The interest in, and attitude toward, the 
secondary education program in the participating communities will 
improve significantly during the life of the project. 


Objective No. 4 


To disseminate the results of Project 501 to interested persons and groups 
in Alberta and beyond.! 


By the time the above objectives had been formulated, the project also 
had been given the label “SEARCH,” an acronym derived from the title 
“Selection of Educational Alternatives for Rural Change.” 


Once the objectives had been agreed to, SEARCH became a demand- 
ing operation for HRRC personnel. A site had to be selected, an opera- 
tional format had to be designed, suitable personnel had to be hired; all 
of these actions had to be completed before the project could be considered 
under way. Examination of a number of possible sites eventually led to 
the signing of an agreement with the County of Lacombe. This agreement, 
approved by the County at a School Committee meeting on May 6, 1969, 
led to the involvement of the high schools in Bentley and Eckville — two 
towns located in the western section of the County and each with a 
population slightly in excess of 700 persons. 

In September, 1969, SEARCH moved into what might be called the 
field phase of the project. The strategies for this phase were developed 
and initiated, for the most part, by a group known as the Provincial 
Task Force (PTF). This group was established in July, 1969, to function 
as an “. . . external ‘change agent’... to help the client system help 
itself’ (Ingram, 1969). The PTF, after consideration of the preliminary 
findings of a commissioned baseline study, decided to press for the creation 
of separate school and community task forces in each of the participating 
communities. This decision proved to be one of paramount importance 
and was a major deviation from the original intent to establish a single 
school-community work group in each locale. 


At about the same period of time, the formation of an Evaluation 
Committee was being considered for the purpose of providing evaluation 
services for the Educational Studies area of HRRC and its various pro- 
ject components. With these developments the operational relationships 
in SEARCH took the form shown in Figure 1. 


The period from September, 1969, to January, 1971, was notable be- 
cause of the number of changes which occurred. The planned Evaluation 
Committee never became effectively established. The Provincial Task 
Force (PTF) ceased its activity by mid-November, some five months after 
its initiation. The writer accepted increased responsibility for the project 
and, as of July, 1970, was named to head the endeavor. Two individuals 


1 An abridgement of the objectives and outcomes as presented in an unsigned and undated mimeographed 
document titled, “Project SEARCH (Project 501 — Selection of Educational Alternatives for Rural Change). 
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Figure 1. Operational Relationships in Project SEARCH as of September, 1969. 


experienced in working with small groups were brought in to serve as 
consultants with the field task forces. The operational base was trans- 
ferred from Edmonton to Calgary to facilitate more effective liaison be- 
tween the project administrator and the project head. Early in 1970 action 
was taken to establish an evaluation team which was to have as its pri- 
mary responsibility the evaluation of the SEARCH operation. A new 
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Figure 2. Operational Relationships in Project SEARCH as of June, 1971. 


component, the Board of Review, was established and had as its member- 
ship representatives from each of the task forces, the project staff, the 
County of Lacombe School Committee (including the Superintendent of 
Schools), and the Zone 4 Regional Office of the Department of Educa- 
tion. By January, 1971, the organizational structure of the project had 
taken the form shown in Figure 2, a form that has remained unchanged 
to the present time. 
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Project SEARCH might be thought of as a social system containing, 
at the time this report was written, six discrete operational entities in- 
cluding the two school task forces, two community task forces, the Board 
of Review, and the project staff (including the two consultants). The 
school task forces are responsible primarily for efforts to design and 
implement new programs in the respective schools. The community task 
forces have focused their attention on ways and means of involving the 
total community in appropriate activities relative to the functioning of 
the school as an integral part of the community. While the school groups 
have as their prime concern the within-the-school aspects of the project 
and the community groups with broader community concerns, the activity 
boundaries of the two have overlapped to a considerable degree and, 
generally speaking, in a mutually supporting fashion. The task forces, 
it must be stressed, are the only operational entities that possess the power 
to initiate direct action relative to the bringing about of innovations in 
the schools and the communities. 


The Board of Review was created after the project was well under- 
way. When negotiations were being conducted with the County of 
Lacombe in April, 1970, for the extension of the project into its second 
year of being, it was proposed that a Board of Review be established to 
distribute money set aside for the support of innovative endeavors of the 
task forces.2 In addition, and perhaps most important for the continued 
viability of the project, it was the intent that the Board would serve as a 
vehicle for improving and maintaining communication among the various 
task forces and between the community and county levels of operation. 
The Board of Review, it was reasoned, might become a means whereby 
the motivation and facilitation of locally initiated attempts to bring about 
educational improvements could be continued after the planned termina- 
tion of the project in 1972. 


The main function of the project staff has been and continues to be 
the support of the task forces in their efforts to work toward the ob- 
jectives of the project. As one might expect, it is the responsibility of 
the staff to look after the administrative details required for the main- 
tenance of the project and to make certain that the activities engaged in 
are consistent with the intent and policies of the prime initiator, the 
Alberta Human Resources Research Council. To date, the support given 
to the task forces has been largely in the form of information and advice 
relative to the problem-solving process, group functioning and possible 
educational alternatives. In its attempts to increase the effectiveness of 
individuals and groups alike, the project staff has designed and held local 
training sessions and, on occasion, sponsored the attendance of individuals 
to selected conferences and workshops. At most meetings of the task 
forces, one or two staff members are in attendance to assist in a variety 
of ways. Continued participation in local sessions enables the staff to 
monitor the progress of the groups and to anticipate accurately future 


and the County of Lacombe agreed to contribute sums of $6,000 and $2,000, respectively, to establish 
an Innovations Fund to support the endeavors of the four task forces. 
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requirements. The role of the staff is not to direct but to facilitate the 
endeavors of the groups in their efforts to bring about educational im- 
provements at the local level of operation. 


A Review of Task Force Endeavors 


A complete and comprehensive review of all activities associated with 
Project SEARCH to the present time is impossible because of the limita- 
tions of space. All that can be attempted is an overview of some of the 
major events and areas of concern of the various task forces. Inherent 
in any limited presentation is the probability that the biases of the writer 
will be reflected to a disproportionate degree, that many significant con- 
tributions of specific individuals will be overlooked, and that information 
necessary for a proper appreciation of the actualities of selected events 
will be omitted. It is hoped that the biases of the author are not too 
flagrant, the information presented sufficient for reader understanding, 
and the failure to recognize significant contributions understood by the 
participants. 


The definitive undertaking of the task forces can be categorized into 
(1) those supported by the Board of Review’s Innovation Fund or (2) 
those conducted without any support from the Fund. Undertakings con- 
ducted without support from the Fund can be financed from trust funds 
made available for and under the control of each of the task forces. Each 
school task force is provided an amount of one thousand dollars to meet 
expenses incurred during the course of any one year. An amount of five 
hundred dollars is provided for each community group for the same pur- 
pose. These task force funds are provided solely by HRRC. 


If any task force requires money for a specific undertaking and deems 
it necessary and/or desirable to approach the Board of Review for sup- 
port, the group is required to present for the consideration of the Board 
a submission which provides information related to the following topical 
outline: 


. General Statement of Intent 
. Statement of Need 
. Outline of Specific Objectives 
. Outline of Project Specifications 
i. Duration of the proposed project 
li. Space and facilities requirements 
iii. Material resources requirements other than space and facilities 
iv. Human resource (paid and volunteer) requirements 
v. Financial resource requirements 
. Outline of Resource Sources 
. Outline of Possible Constraints 
. Statement of Strategies for Overcoming Possible Constraints 
. Project Management Plan 
. Project Communication Plan 
. Statement of Support Required from Board of Review 
i. Essential support requested 
ii. Desired but not essential support requested (Project SEARCH Board 
of Review, 1970). 


Sty (ayn ter! ts) 
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Any proposal submitted to the Board of Review is appraised and a 
decision made regarding the degree of support it is to be given. In ar- 
riving at its decision, the Board concerns itself with factors such as the 
relevance of the planned undertaking to established needs and the ob- 
jectives of SEARCH, the legality and legitimacy of the proposed actions, 
the probable long and short range impact of the endeavor on other acti- 
vities and programs, the practicability of the proposal, and the possible 
pay-off relative to the investment of resources required. Following due 
consideration of the submission, the Board must take one of the follow- 
ing courses of action: 

a. Approve, without modification, the proposed project and allocate a sum 
of money from the Innovations Fund for the support of the project. 

b. Approve the proposed project with the provision that certain stipulated 

modifications must be made and allocate a sum of money from the In- 

novations Fund for the support of the project as modified. 
c. Approve the proposed project (with or without the stipulation that it 

be modified), allocate a sum of money from the Innovations Fund for the 

support of the project, and recommend to the sponsoring group or groups 
that the proposal be submitted to other agencies for support. 

d. Return the proposal to the sponsoring group with a recommendation 
that it be resubmitted to the Board of Review after certain specified al- 
terations are made. 

e. Reject the proposal and return it to the sponsoring group with a clear 

indication of the reasons for rejection of the proposal. 

f. Reject the proposal and return it to the sponsoring group with the re- 
commendation that it be submitted to some other agency (to be named) 

for support and funding. (Project SEARCH Board of Review, 1970). 

As of September 15, 1971, the Board of Review had received and con- 
sidered five separate requests for support; all five were funded to the 
extent that the proposed activities could be undertaken by the sponsoring 
task forces. 


Bentley Community Task Force Endeavors 


The primary concern of the Bentley Community Task Force (BCTF) 
has been to develop an effective group operation and, as a result, has 
focused mainly on the interaction process as it relates to the performance 
of group members in problem-solving situations and to the functioning 
of the school in its community environment. 

Early in 1970 the BCTF undertook an ambitious survey of the thinking 
of the community with regards to educational needs and concerns. The 
first step was to hold a workshop for members of the task force on needs 
analysis and problem-solving. This preparatory activity was followed by 
the development and administering of a “Survey of Opinions on Educa- 
tion.” The data from the survey of community thinking were compiled 
and analyzed by the group. Information from a study commissioned by 
HRRC (MacKay, 1970) was used to supplement and verify the findings 
and became the focal point of considerable discussion. By the end of 
the year the membership of the task force? was in agreement that a major 


* By this point in time four members of the teaching staff of the Bentley High School were active members 
of the BCTF. 
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effort should be made to find ways and means of improving the relation- 
ships between the school and community — an area of prime concern 
revealed by the survey. 


As a result of its initial activities, the BCTF was in a reasonably good 
position to accept from the County School Committee an invitation to 
prepare a report pertaining to the objectives of the school in Bentley. 
Following a series of small group interviews conducted by its members 
and involving about one hundred adults and fifty students, the task force 
presented to the County School Committee meeting of May 10, 1971, an 
“Interim Report . . . Regarding the Objectives for Bentley School Com- 
munity” (Bentley Community Task Force, May 10, 1971). 

While dealing with the problem of defining objectives, the group be- 
came involved in considerations related to the desirability of upgrading 
the school plant and its physical facilities. The end result of these con- 
siderations was the submission of another report to the County School 


Committee. This report dealt with “. . . the area of building and site 
changes from a Community point of view,” and suggested to the school 
trustees that “.. . any renovations and/or additions you choose to make 


to the school be planned in such a fashion that the facilities be accessible 
to the community as much as possible and, therefore, eliminate needless 
duplication of facilities in the community” (Bentley Community Task 
Force, June 7, 1971). To what extent the dialogue between the task force 
and the school committee prompted subsequent developments is difficult 
to ascertain; however, during the summer vacation period considerable 
renovations and improvements were made to the Bentley High School 
building. 


Bentley School Task Force Endeavors 


A definitive and stable role for the Bentley School Task Force (BSTF) 
evolved slowly and not without considerable frustration on the part of 
all concerned. Though the group began its deliberations early in the 
1969-70 school year, it was not until the summer months one year later 
that any degree of consensus began to emerge as to the functions to be 
performed by the group. The arduous task of finding time for needed 
dialogue, a variety of conflicting expectations, and the lack of clearly 
stated guidelines for the total project and its component parts appeared 
to be some of the major reasons for the difficulties encountered. In spite 
of many problems, an agreement was reached that the task force would 
serve primarily as an advisory group for those individual teachers wishing 
to experiment with new instructional modes and techniques. 

During the period of time taken by the group to establish a concept 
of its own role and operational format, two significant developments 
occurred. One such development was the involvement of the principal 
and some members of the task force in the activities of the community 
group. This involvement increased substantially the opportunity for ef- 
fective cooperation between the school and the community. The second 
development, judged by the writer to be of considerable significance, was 
one which led to the first request to the Board of Review for the funding 
of an innovative project. On the initiative of the SEARCH staff, the 
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principal of the Bentley High School was given an opportunity to visit 
a number of schools involved in the Western States Small Schools Project. 
His observations of the activities in these American schools, as reported 
to the task force members, prompted the home economics teacher to 
investigate further a program for individualizing instruction in her sub- 
ject area. As a result of this inquiry, a proposal was developed and sub- 
mitted by the BSTF to the Board of Review for necessary funding. At 
its meeting on August 28, 1970, the Board allocated the requested amount 
of money ($1,005.50) to support the implementation of an instructional 
program known as “Individualized Home Economics” (Bentley School Task 
Force, 1970). This particular program was launched and subjected to 
considerable scrutiny during the 1970-71 school year. In a commissioned 
evaluation of this project the following comment was made: 

The pilot study involving Individualized Home Economics Instruction at 

Bentley High School can be viewed as a success in reference to student 

enthusiasm and interest in the new program. Individualized instruction as 

a teaching method is an improvement over the traditional teaching method 

practiced at Bentley in the past (Hakstian, Muller and Hugstad, 1971, p.47). 


The materials and procedures used in this program have been refined 
and will be further tested during the current school year. 


A second request was made by the task force to the Board of Review 
on April 30, 1971. This request for the support of “. . . an Experimental 
Project in Film Making in High School English” (Bentley School Task 
Force, 1971), resulted in the Board assigning the sum of $500.00 to the 
endeavor. At the time of writing, there has been no formal report regard- 
ing the success of this venture. 


Eckville Community Task Force Endeavors 


Two features tend to distinguish the Eckville Community Task Force 
(ECTF) from its Bentley counterpart. One such feature is the nature of 
its membership. From the time of its first meetings, the Eckville group 
has attempted to achieve active student involvement in its endeavors. 
Students have not been participating members of the Bentley community 
group in its period of operation to date. Another difference in the member- 
ship characteristics of the two groups relates to continuity of involve- 
ment. Since the establishment of the two groups late in 1969, the mem- 
bership of the BCTF has been relatively stable in terms of the numbers 
actively participating in meetings of the group; this number tends to be 
about twelve for most sessions. The membership of the BCTF also has 
been rather stable in terms of continuity of participation. For the most 
part, the same individuals have been active in the group throughout its 
span of life. 


The situation with the Eckville group has been very different. The 
size of the Eckville CTF has fluctuated greatly, with attendance figures 
ranging from less than five to more than thirty. With the exception of 
a core of about five individuals, the pattern has been for individuals to 
participate for periods of short duration. 


A second feature tending to make the two community groups dif- 
ferent relates to the areas of prime concern. The BCTF deliberately has 
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focused much of its efforts on the development of group performance 
skills. On the other hand, the ECTF has focused its attention and ef. 
forts on selected and specific tasks. The BCTF has been essentially 
process-oriented while the ECTF has been product-oriented. 


In its early deliberations the Eckville group identified as urgent the 
need for a locally based driver training program. Though often discussed, 
little direct action was taken to satisfy the expressed need until October, 
1970. One reason for the delay in dealing with the need for driver train- 
ing was the group’s decision to conduct a survey of community concerns 
about the educational program and related matters. The survey paralleled 
in time and scope a similar undertaking by the community task force 
in Bentley. Following the completion of its survey during the summer, 
the task force decided to direct its energy to making available a program 
of driver training for Eckville students. Acting with a sense of purpose 
and considerable dispatch, the group developed a case for and designed 
the details of such a program. The resulting brief requested financial 
support from the Board of Review’s Innovation Fund. This support was 
granted on November 27, 1970, and an Alberta Motor Association program 
was implemented during the second semester of the school year. The Board 
of Review subsequently received a report that ‘of the thirty students 
who started the course all . . . completed it and received their A.M.A. 
certificate card.”4 Whether or not such a program will be offered in 
the community during the current school year has not yet been decided. 


A second major product of ECTF deliberations has been the forma- 
tion of a body known as the Eckville Community-School Advisory Board. 
Acting largely on the initiative of the community group, the two Eckville 
task foces moved to establish an Advisory Board to “provide communica- 
tion links between the community, the County Board, and the school” 
and to make “recommendations to appropriate individuals or groups 
for various aspects of the operation of the Eckville schools when asked 
or when a need is felt” (Eckville Community Task Force, 1971, p. 7). 
Awareness of the need for such a body came about because of information 
resulting from the community survey, HRRC’s commissioned baseline 
study of the community and the school (MacKay, 1970), and the numerous 
meetings of the ECTF. The three students, two teachers, three parents, 
and one school trustee that constitute the membership of this new body 
anticipate that the first meeting will take place early in the fall of 1971. 


Eckuille School Task Force Endeavors 


Though faced with the same basic difficulties that frustrated the Bentley 
school group, the Eckville School Task Force (ESTF) was able to launch 
a specific project much earlier than was the case in Bentley. On Septem- 
ber 24, 1969, four members of the Eckville staff volunteered to serve on 
a committee created to explore some possibilities for establishing a 
school planning group. One week later the school staff and SEARCH 
personnel “. . . were confronted with a problem which was in urgent 
need of resolution if the Project were to be implemented in the school. 


4 Report presented to the Board of Review meeting, April 30, 1971, titled “Summary of Driver Education at 
Eckville.” 
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The problem was that of the teaching staff being able to obtain time for 
participation” (West, 1970, p. 7). So it was that even before the Eckville 
School Task Force became established, a concern which was to stimulate 
the launching of the first major task force activity in the SEARCH pro- 
gram had come to the surface. This major activity, designed to assess 
a strategy for freeing the time of teachers so that participation in 
SEARCH endeavors would be possible, became known as the Eckville 
Teachers’ Aide Project and was effectively launched by February 1, 1970. — 
Its period of operation covered the next six months. 


In December, 1969, it was agreed that the task force would be a per- 
manent operational group in the high school of Eckville. Though a sub- 
stantial number of meetings were held during the balance of that school 
year, there was little accomplished that was of a definitive nature except 
for the Teachers’ Aide Project. As was the case for the Bentley School 
Task Force, the major obstacles faced by the group were lack of adequate 
time, conflicting expectations, and the nonexistence of precise opera- 
tional guidelines. In addition, when the school began its operations for 
the 1970-71 school year, it was necessary to start almost from the begin- 
ning because all staff members who had been most actively engaged in 
the deliberations of the group had either terminated their affiliation with 
the school or had ceased to be full-time members of the teaching staff. 


During its second year of existence the Eckville STF was able to 
launch a two-part project. In November, 1970, the Board of Review, 
reacting to a proposal presented by the ESTF, made available financial 
assistance for the initiation of a program of planned change. The pre- 
sentation to the members of the Board of Review stated that the program 
was to be concerned with: 


1. The development of an individualized science program for the junior 
high school students (grades 7 through 9) which would be implemented 
in the 1971-72 school year. 


2. The initiation and execution of a program of activities (undertaken in 
cooperation with the Eckville Community Task Force) designed to: 


a. Undertake an appraisal of “people” needs in the Eckville School 
and Community. 


b. Determine the resources available for the possible satisfaction of 
some of the identified “people” needs. 

c. Develop plans for bringing about the effective and efficient utiliza- 
tion of the available resources in providing for the satisfaction of some 


of the more important and urgent school and community needs (Eck- 
ville School Task Force, 1970, p. 1). 


It was pointed out in the presentation that most of the requested fi- 
nancial assistance would be used to employ additional staff so that the 
four teachers concerned could be freed from a portion of their regular 
teaching responsibilities. Though the work done on the two parts of the 
undertaking was substantial, considerable frustration was encountered 
because of difficulty in obtaining suitable relief staff. The extent of real 
progress in the attainment of the objectives of this project will be esta- 
blished during the coming months. 
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Some Observations and Suggestions About Development Projects 


At this point in the life of Project SEARCH the writer is unable to 
present any definitive conclusions or to make any specific recommenda- 
tions resulting solely from his experience with and the data already ob- 
tained from this particular project. All that can be done is to make some 
general observations and suggestions based on his involvement in SEARCH 
and other similar undertakings. The observations and suggestions that 
are presented in the following section have been restricted to comments 
about the design and implementation of field-based and field-involved 
development undertakings at the school or community level of operation. 


Developing the Design 


The creation of a design for any development endeavor is without 
question the most critical single major event in any project. It is the 
foundation on which all subsequent activity is based. The design must 
be comprehensive, that is, it must take into account all conceivable di- 
mensions of the project. It must be compatible with other planned acti- 
vities and events with which it must coexist in the school or system. 
It must be detailed to a degree that might appear to many to be absurd 
and a wasteful use of the resources of the design team. Above all and 
in spite of its complexity, the design must be capable of being under- 
stood by everyone who will relate to it in the future whether they be 
trustees, teachers, central office personnel, consultants or evaluators. 


The design should be based on a thorough and accurate assessment 
of the current state of affairs; a clear statement of the short, inter- 
mediate, and long range objectives of the agencies involved; and a pre- 
cise definition of the nature of the problem which is to be the focal 
point of the endeavor. In short, the project design must be based on 
accurate information as to “what is” and “what is to be.” 


Once the design team has the necessary antecedent information, at- 
tention can be given to the creation of the design itself. However, any 
design that is generated in the early stages of the planning process 
should be considered as tentative. It is suggested, resources permitting, 
that efforts be made to sketch out a number of design possibilities before 
any enduring commitment is made by the planners. One format for the 
design of development projects that has been successful in a variety of 
situations is that which was presented in the preceding section as a guide- 
line for those in SEARCH who make submissions for support to the 
Board of Review. 


There are many aspects of the design operation that require further 
elaboration but limitations of space restricts such discussion; however, 
there are four points that can be stressed. First, the development of an 
adequate project design is a demanding and time consuming task that 
requires a substantial investment of resources. Such an investment must 
be made and must be considered to be of a high risk nature. Second, any 
design must be both flexible and adaptable. It should be capable of being 
expanded or reduced in scope depending on future conditions. Allowances 
must be made to exploit new opportunities that arise or to deal adequate- 
ly with unanticipated difficulties. Major decision points must be noted and 
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provision made to cope with a wide range of possibilities, some of which 
are bound to be unknowns at the time the design is being developed. 
Third, the objectives of the project must be stated in terms that are 
operationally meaningful. If the statements that are to serve as guidelines 
for all subsequent activities are obscure, one can say with a fair degree 
of confidence that the individuals involved will be unduly frustrated, 
activities will be confused, and scare resources will be wasted. The 
fourth and final point to be emphasized is the need to make certain that © 
those individuals who are to assume primary responsibility for the imple- 
mentation and maintenance of the project are meaningfully involved in 
all stages of the design phase. In other words, accountability for the 
achievements of the project cannot be properly assigned to, or assumed 
by, any one individual or group of individuals unless they have been 
key figures in the design phase of the operation. 


Implementation of the Design 


Only after the design has been developed and subjected to severe 
scrutiny can the implementation phase begin. Implementation must start 
with those people who are to be involved in the project being given a 
comprehensive picture of intended activities and events. They must be 
given an opportunity to develop any new skills required by them in the 
performance of their assigned and precisely defined roles. Care must 
be taken to make known to all participants the extent of the investment 
expected of each individual. All must be aware of any potential risk 
and pay-off possibilities that exists for agencies and individuals concern- 
ed. Coercion, half-truths, and hidden agendas have no place in develop- 
ment projects. Experience has shown that in any community there are 
many teachers, parents, and students who are prepared to make major 
investments of time and energy, who are willing to take risks for minimal 
or no personal gain, and who are ready to accept frustrations and disap- 
pointment in the hope that they can contribute to bringing about educa- 
tional improvements. However, these same individuals are apt to be re- 
luctant and unproductive participants if they do not consider the intent 
of the project to be important, if they are confronted with a plan that 
is obscure, if they perceive risks and pay-off to be unfairly distributed, 
or if they assess the expectations held for them to be unreasonable. 


Conclusion 


To what extent Project SEARCH will be successful in achieving the 
objectives set out for it is open to speculation at the present time. There 
is no doubt, however, that those who have been involved in the endeavor 
will have learned a great deal about the essential requirements for similar 
undertakings in the future. Therefore, regardless of the eventual outcome, 
the challenge in the future for the project staff will be to consolidate what 
has been learned and to make such information available to others de- 
Sirous of attempting to bring about significant improvements in their 
particular school, system, or community. 


In light of past experiences, the promise of the future appears to de- 
pend on the extent to which the prime decision-makers in the field of 
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education are prepared to accept the contention that “to try and fail 
is at least to learn; to fail to try is to suffer the inestimable loss of what 
might have been” (Barnard, 1938, dedication page). This is what SEARCH 
is all about. 
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Evaluation Research with Illustrations 
From Project SEARCH! 


Evaluation research is defined and the increasing demand for such research 
is noted. A simple model for service and development programs is pre- 
sented to illustrate the function of evaluation research within a dynamic 
system. The implications of this model and the problems confronting per- 
sonnel responsible for the evaluation function of a complex or multi-goal 
project are discussed with reference to Project SEARCH. Some conclud- 
ing comments are made regarding the professional development of evaluation 
researchers. 


The Meaning of Evaluation Research 


Project SEARCH illustrates a venture in development and social change. 
It is a goal-oriented activity and therefore qualifies as an object for 
evaluation research. 


The scientific study of such ventures which assesses the degree to which 
they achieve their objectives and which explains the reasons for their 
success or failure constitutes evaluation research. Suchman (1967) defines 
evaluative research as “‘the utilization of scientific methods and techniques 
for the purpose of making an evaluation” (p. 7). He thus distinguishes 
between evaluation as a general construct and evaluation research as a 
specific type of evaluation. The purpose of evaluation is to judge the worth, 
value, or impact of some goal-directed activity. Evaluation research is that 
particular mode of evaluation which strives to employ the techniques 
of scientific research in order to minimize the degree of subjectivity 
entering into the assessment. 

From the outset, we would like to proclaim our concurrence with 
Suchman’s point of view. We, too, regard evaluation research essentially 
as research, and we believe that it should adhere as closely as feasible 
to the cannons of scientific methodology. 


! The writer wishes to acknowledge his indebtedness to Mr. William Lang and to Dr. W. Zwirner who read 
the original manuscript and who provided several helpful suggestions for revision. 
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Growing Demand for Evaluation Research 


Increasing awareness of the need for evaluation as a technical service 
to development programs (eg. Project SEARCH) and to service programs 
(eg. health, education, and welfare programs) is likely to result in the 
rapid development of evaluation research as an area of professional 
specialization. The acceleration of social change, the expansion of knowl- 
edge, the emergence of participatory democracy, and the demand for ac- 
countability are contemporary phenomena which encourage and support > 
the growing demand for evaluation research. 


In the concluding chapter of Future Shock, Alvin Toffler (1970) argues 
that we are now at that supreme instant in history when man shall be- 
come either master or victim of the processes of change. Assuming that 
man diligently strives to become master rather than victim, his efforts to 
capture control of and to provide direction to social change are likely to 
succeed only through programmatic action. Such action must be both 
planned and rigorously evaluated. 


The explosive development of knowledge makes contemporary wisdom 
appear antiquated, thus creating a demand for a variety of innovations 
within our social institutions. Business corporations, eager to capture 
new markets, are likely to develop and promote a wide variety of new 
procedures and products. It is fairly safe, therefore, to predict that 
evaluation research increasingly will be called upon to determine the de- 
gree to which new ideas, new knowledge, new technology, and new 
products can be put to practical use. Most studies regarding the ap- 
plication of computers in education, for example, may be construed as 
evaluation research. Moreover, these studies frequently illustrate the ef- 
fective use of scientific methodology to evaluate the potential application 
of new technology within a specific context (eg. Hallworth et al., 1971). 


By incorporating more and more people in the social decision-making 
process, the trend toward participatory democracy has created a need 
for a technology capable of providing to the populace “credible informa- 
tion” concerning the probable consequences of alternate courses of action. 
As Lortie (1967) notes, “the necessity to make choices forces people to 
attend to the grounds for choice” (p. 3). Evaluation research, through 
rigorous collection and objective analysis of data regarding the relative 
costs and benefits of various trade-offs is admirably suited to provide the 
basis for rational choice in the realm of social policy. 


The ever-growing spectrum of social alternatives coupled with the 
recognition that our resources are not infinite has created a demand for 
accountability. Social service programs will require ‘proof’ of their ef- 
fectiveness relative to their costs if they are to enjoy society’s continued 
support. That proof is likely to take the form of an “independent audit” 
or external evaluation. 


A Basic Model for Service and Development Programs 


According to the editors of Education U.S.A. (1971), “accountability” 
has a very specific meaning for service and development programs. This 
meaning is conveyed by the following formula: ‘Decide what it is you’re 
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going to do. Do it. Then prove that you’re done it” (p. 9). Three some- 
what discrete functions are implied: setting goals, operating upon the 
environment to achieve those goals, and evaluating the degree to which 
they are achieved. Although amazingly concise, this definition of account- 
ability also contains the three basic functions in a more general model 
for service and development projects. 


Figure 1 presents a skeletal outline of such a model. By providing only 
a single level of detail, systems builders are left with freedom of “de- 
signer’s choice” to elaborate higher levels of detail. The total system en- 
visoned by Figure 1, however, is characterized as open, dynamic, and 
multicausal. 


SPECIFY 
OBJECTIVES 


EVALUATE PERFORM 
PERFORMANCE NECESSARY 
OPERATIONS 


Figure 1. A Basic Model for Service and Development Programs. 


Signal paths leading from ‘Specify Objectives’ to “Perform Neces- 
sary Operations,” and from “Perform Necessary Operations” to “Evalu- 
ate Performance” indicate the sequential dependence of the latter func- 
tions upon the existence of the former. One cannot perform a coherent 
series of operations intentionally designed to achieve a set of goals 
until those goals have been specified. Moreover, one cannot evaluate the 
procedures or operations intended to achieve specified goals until those 
operations have at least conceptual existence. Efforts to evaluate without 
first specifying both objectives (the dependent variables) and the opera- 
tions calculated to produce these objectives (the independent variables) 
according to Suchman (1967), is like undertaking basic research without 
formulating an hypothesis. 


The relations among the basic functional components of the model 
are not limited, however, to the linear or sequential aspect. Each com- 
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ponent in the system influences and is influenced by every other com- 
ponent. The results of evaluation, for example, may elicit a reformulation 
of objectives or a modification in operational design. Modifications in 
these components, in turn, will require alterations in planned procedures 
for evaluation. The unspecified complex network of feed foreward and 
feedback loops which characterize the dynamic relationships among the 
basic components of the model is graphically represented in a manner 


suggested by Silvern (1969) by signal paths converging to a central dot. | 


Implications of the Model for Evaluation Research 


Our experience with Project SEARCH illustrates the importance of 
attending to the dynamic relations among the basic functional com- 
ponents of the Project. The initial specifications of project goals, as pre- 
sented by Ingram (1969) in a rationale for the project, was developed 
before the Project Head assumed responsibility for “operations” and be- 
fore the writer was appointed as “Evaluator.” The design for both 
“operation” and “evaluation” functions, moreover, were drafted in re- 
lative isolation from one another. This failure to establish workable re- 
lations of dynamic influence among the basic functional components of 
the project constitutes a serious weakness. 


Those responsible for the evaluation of Project SEARCH were not 
involved in setting out its objectives and thus were unable to influence 
the specification of those objectives in terms of outcomes which are ob- 
servable or amenable to criterion-referenced measurement. The failure 
of both operations and evaluations personnel to participate in the specifica- 
tion of objectives, moreover, creates some doubt regarding the validity 
of their interpretation. Of considerable concern is the possibility that 
operations personnel may devote their efforts to the achievement of one 
set of outcomes while evaluations personnel assess quite another. 


Appropriate involvement at the planning stage and continuous co- 
ordination of all three functional units throughout the life of a develop- 
ment project such as SEARCH would do much to increase its effective- 
ness. This suggestion, perhaps, requires some clarification. We are not 
arguing that “he who pays the piper must allow the piper to call his own 
tune.” There are no logical reasons why one may not enter into a per- 
formance contract to produce outcomes, the formulation and evaluation 
of which are beyond his purview. Such a contractor, if prudent, however, 
will insist upon unequivocal and perhaps written specifications of the 
outcomes that he has agreed to achieve and the criteria for their 
evaluation. 


Projects vary in the degree to which their objectives are amenable 
to unequivocal specification, especially at the initial stages of project 
development. For example, projects to increase profits, to reduce the in- 
cidence of dental caries, or to improve reading comprehension are rather 
straight forward. The goals for such projects are clear and their evaluation 
is a relatively simple task. When this situation obtains, the dynamic re- 
lations among goal specifications, operational procedure, and evaluation 
are of lesser significance. 
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A statement of the ultimate purpose of Project SEARCH _ illustrates 
the problems which arise from the goal ambiguity inherent in complex 
social innovation projects and also illustrates the importance of early and 
continous dynamic interaction among those who design projects, those 
who carry them out, and those who evaluate them. 


Assessing Educational Opportunity 


As presented in the project’s rational (Ingram, 1969) the major aim of 
Project SEARCH is “to develop ways and means of increasing educa- 
tional opportunities and improving educational programs for rural youth 
of high school age’ (p. 8). 


Interviews with a sample of residents from both project communities 
indicate almost unanimous support for this broad goal. Nevertheless, 
when an attempt is made to specify the meaning of educational op- 
portunity in order to provide for its measurement, we discover that a wide 
variety of meanings attach to the concept. The population of a pluralistic 
society holds diverse values. 

As an evaluator, whose meanings and whose values do you choose? 
Attending to this methodological question, Ingram and West (1971) else- 
where, have suggested the development of a phenomenological solution. 
In short, the measurement of educational opportunity would become “idio- 
criterion-referenced” (ie., each subject in the assessment sample would 
be free to specify those criteria which for him constitute an educational 
opportunity). Opportunity, from this point of view, may be regarded as 
an individual matter. It is important to note that such assessment makes 
no reference to the definitions of experts or the norms of society. In 
other words, a case may be made that both criterion-referenced measure- 
ment in which the criteria are determined by professionals, and norm- 
referenced measurement are inappropriate and therefore invalid for our 
particular purpose. 


Although idio-criterion-referenced measurement which we_ suggest 
for the assessment of educational opportunity is an extension of the con- 
cept of criterion-referenced measurement, the assumptions underlying 
such measurement are consistent with the later construct. Since publi- 
cation of Robert Glaser’s (1963) classical paper which distinguishes 
between norm- and criterion-referenced measurement, there has been in- 
creasing appreciation for the superior validity of the later to assess 
the achievement of educational objectives (Popham, 1971). 

The proposed technology for the assessment of educational opportunity 
remains undeveloped at present, and will not be available for use in 
the valuation of Project SEARCH. 

It is of particular importance to note at this point in our discussion 
that the post-planning, on-site experience of grappling with the problems 
of specifying, defining, and measuring such concepts as “educational 
opportunity” and “improved educational programs” has led to significant 
learning outcomes. Such problems could not have been anticipated during 
the initial stages of project planning. 
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Indeed, if we are to gain valuable insights about complex social service 
or development projects we cannot forever remain at the stage of arm- 
chair preplanning. We must launch out with a tentative agenda for 
action. A system of formative evaluation with its continuous feedback 
to the “goal specification” and “operations” components of the project 
will assure those revisions and modifications necessary to improve an 
imperfectly conceived design. 


In short, despite our general emphasis upon the dynamic relation- 
ships among the basic components of broad-goal projects and the im- 
portance of establishing these relations early within the planning stages 
of the project, we do not argue that Project SEARCH, in particular, was 
hastily conceived or prematurely given birth. Rather, we would suggest 
that given the current stage of Research and Development experience in 
Alberta, Project SEARCH offered a truly unique opportunity to “learn 
by doing” not only for those engaged in project development and ad- 
ministration but also for those engaged in project evaluation. Moreover, 
the dissemination of our experience, hopefully will prove instructive to an 
even wider audience. In this regard, the project has served admirably 
one aspect of HRRC’s mandate: 


to encourage and facilitate the training of persons engaged in educational, 
social, economic, and other related research. (The Human Resources Re- 
search Council Act, 1967) 


Confronting a Failure of Nerve 


Perhaps the easiest of all research assignments is to develop the ideal 
evaluation design. Yet the most difficult assignment, no doubt, is to carry 
out such a design in practice. The history of Project SEARCH indicates 
that suggestions for and criticisms of proposed evaluation plans were 
readily available from a variety of both professionally recognized and 
self-styled experts. By way of contrast, the number of researchers who ex- 
pressed a willingness to contract responsibility for conducting even a 
small portion of the evaluation has been disappointing. Moreover, the 
attrition rate for those who have been involved in the evaluation of the 
project has been high, indeed. It is easy to set standards and draft plans 
that you do not have to live by, but the task of getting on with the “nitty- 
gritty” execution of those plans in a real-life setting is messy business. 


Socialized in the norms of pure research, our initial plans for evaluation 
tended to be elegant, academic, ambitious, but impractical. We wanted 
to do too much of the wrong thing. We discovered to our dismay that the 
evaluator, unlike the pure researcher, has little control over the situation. 
He must often remain unobtrusive, silent, and apparently inactive. Al- 
though he is obliged to evaluate he must not interfere with the smooth 
flow of operations’ activities. The Project Head of SEARCH, for example, 
legitimately requested that 


... the operation group must be in a position to request and, if necessary, 
direct changes in evaluation activities and procedures which might be seen 
as threats or hinderances to the viability of field activities (Roberts, 1970). 
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We soon realized that reality imposed constraints which had to be faced 
if ever we were to get on with the job. In short, we had to confront a 
“failure of nerve,” Although that term most commonly occurs in philo- 
sophical discourse, Skinner (1971) suggests that: 


The expression is an indirect way of talking about out failure to take 
effective action ... (p. 35). 


The stakes were high. Few scholars are prepared to gamble with what- 
ever academic prestige and influence they have devoted a lifetime to 
develop. Fortunately, a penchant for situational ethics and a willingness 
to deviate from absolute norms, when necessary, provided the courage to 
make those trade-offs required for survival as evaluators. In the place of 
carefully controlled conditions, so essential to pure research, we often had 
to settle for carefully observed conditions (eg., monitored video-tape re- 
cordings of all task force meetings). When expedient, we sacrificed the 
criterion of statistical significance for that of practical relevance (cf. 
Guba, 1969). In the place of experimental verification we had to resort 
to a variety of reasonably veridical sources of converging evidence (eg., 
data gathered from interviews, questionnaires, etc.). 


The foregoing comments must not be construed to indicate abandon- 
ment of our original declaration of faith in the ability of scientific method 
to provide useful direction to the process of evaluation research. We simply 
have come to appreciate that the degree to which the cannons of scientific 
rigor are met, even in basic research, is a relative matter. To compromise 
with the ideal may be unfortunate, but it is hardly catastrophic. 


Albert Ellis (1971), commenting on psychological health and well be- 
ing states that emotional disturbance is always the product of demand- 
ing rather than desiring. Analogously, we would suggest that the failure 
of nerve which prevents many outstanding scientists from making valuable 
contributions to the methods and practice of evaluation research arises 
from an over-socialization in the norms of scientific purity. 


Science is an attitude as well as a method; moreover, it is a means 
rather than an end. As a useful tool for the social sciences, it must serve 
rather than control man’s search for knowledge and understanding. Guba 
(1969) effectively illustrates this principle: 


Perhaps the most damaging assertion that may be made about the ap- 
plication of conventional experimental design to evaluation situations is 
that such application conflicts with the principle that evaluation should 
facilitate the continuous improvement of a program. Experimental design 
prevents rather than promotes changes in the treatments because . . . 
treatments cannot be altered if the data about differences between treat- 
ments are to be unequivocal. Thus the treatment must accommodate the 
evaluation design rather than vice versa (p. 34). 


As science is not an all-or-none phenomenon, the project evaluator 
will do well to avoid the either/or fallacy with respect to scientific 
methodology. A lack of scientific purity does not imply promiscuity. Al- 
though we must continuously strive for greater scientific rigor in our 
evaluation designs, we must refrain from demanding adherence to nothing 
short of the ideal design and we must stop grumbling (or, in the language 


237 


L. W. West 


of Ellis, awfulizing) about the compromises which reality imposes. To 
the evaluator of service and development programs, especially those 
which are characterized by multiple or broad goals, demanding is dys- 
dunctional and awfulizing is debilitating. 


What Do We Evaluate? 


Having confronted a failure of nerve and having acknowledged that | 
we must take immediate and effective action to provide some form of 
evaluation for Project SEARCH, we then were confronted with a new 
decision problem: What do we evaluate? 


Obviously, not all facets of a complex endeavour can be carefully 
observed, documented, measured, or subjected to detailed analysis. 
Evaluation always entails some selection of what is and what is not to 
be evaluated. Moreover, that decision introduces an element of subjec- 
tivity into the evaluation process. Fortunately, various evaluation taxono- 
mies based upon a wealth of evaluation experience have been developed 
which provide some guidance regarding the selection of those aspects of 
a project most worthy of the evaluator’s attention. 


Stake (1967) makes a distinction between the theory of evaluation 
which deals with the problems of what is to be observed and judged and 
the methodology of evaluation which specifies how such observations 
and judgements are to be made. With this distinction in mind, we now 


shall turn briefly to the theory of evaluation as it relates to Project 
SEARCH. 


One popular method of classifying evaluation activities has been pro- 
vided by Stufflebeam (1968). Briefly, the CIPP model identifies four 
classes of project decisions; hence, four corresponding types of evalua- 
tions — context, input, process, and product. 


Context evaluation occurs in the initial stages of project planning. 
Its essential purpose is to describe the environment in which the change 
or service is to occur. This type of evaluation provides background infor- 
mation for specification of the more immediate project goals. The context 
evaluations for Project SEARCH are reported in a series of “baseline 
studies” conducted by MacKay (1970). 


Input evaluation, with reference to SEARCH, has two major purposes. 
First, it must identify and assess those resources and capabilities of the 
Human Resources Research Council and of Project SEARCH personnel 
to achieve stated project goals. Secondly, it must assess alternative 
strategies or methods of achieving these goals in terms of potential 
costs and benefits. The end product of input evaluation is a project or 
operational design. In a dynamic system, an operational design, however, 
must not be rigid or inflexible. As previously noted, initial operational 
designs were drafted in relative isolation from the evaluation unit. 

It is obvious from the foregoing discussions that the evaluation unit 
of Project SEARCH was not given a mandate to conduct either context 
evaluations or input evaluations. Rather, it has been the implicit under- 
standing of all concerned that the evaluation unit would limit its sphere 
of activity to process and product evaluations. 
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Process and product evaluations are essentially equivalent to the 
formative and summative evaluations described by Stake (1967). The 
major purpose of process or formative evaluations is to monitor opera- 
tional activities and to provide periodic feedback to the personnel charged 
with operations in order to permit a continuous refinement of plans and 
procedures. 

Product or summative evaluations are those evaluations which are 
carried out at the conclusion of a project. Since they have no potential 
for influencing project operations, their major function is to provide a 
terminal assessment of the relative merits of various procedures and the 
worth of the project as a whole. 


Suchman (1967) makes a further distinction between evaluations of 
effort and evaluations of performance. It will be recalled that the basic 
model presented in Figure 1 made reference to the evaluation of perfor- 
mance. 


The evaluation of effort is concerned with the amount of resources 
expended in the pursuit of project goals. Effort evaluation assumes that 
all action taken on behalf of the project is an effective or valid means 
for goal accomplishment. Obviously, this assumption is often untenable. 
Our best efforts sometimes lead to negligible results and an “A” for 
effort is hardly consolation. 


Effort evaluation is relatively easy to conduct. In the case of Project 
SEARCH, for example, simple administrative records might indicate such 
things as total economic expenditure for SEARCH operations, the number 
of field trips made by HRRC personnel, the number and duration of task 
force meetings, the size and regularity of attendance, the number of sug- 
gestions made by each task force member during a meeting, the number 
of educational innovations initiated, and the like. Although such data 
provide no certain indication that progress is being made toward the 
achievement of project goals, it is nonetheless relevant as an indication 
of what may and what may not be held potentially accountable for the 
success or failure of the project. 


Performance evaluation is concerned with the results or the out- 
comes of effort rather than with the effort per se. It is performance 
evaluation which requires that project goals be specified clearly and un- 
equivocally in terms of outcomes amenable to behavioral description and 
criterion-referenced measurement. 


Suchman (1967) suggests that we continue beyond mere performance 
evaluation to the evaluation of performance adequacy. This criterion of 
evaluation is nicely illustrated with reference to Project SEARCH. A 
secondary goal of Project SEARCH and one which may be construed 
as the principal means for achieving the overall purpose of the project 
is to develop within the project communities a “self-renewing system” 
of community involvement and participation. At minimum, such a system 
implies a substantial number of citizens who posses both the motivation 
and skill (communication and problem solving skills, in particular) to 
cope with social change and to achieve consensus in designing the future 
for their community with a minimum of external intervention. For the 
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purpose of illustration, assume that all task force members of Project 
SEARCH (representing fewer than 1 per cent of the communities’ total 
population) were to develop to an optimum level the motivation and skills 
previously alluded to; would this outstanding performance, by so few, 
be adequate to the task of assuring the existence of a self-renewing 
system within the communities at large? Such are the questions we must 
face if we dare to evaluate performance adequacy. 


A final aspect of performance evaluation concerns efficiency. The cur- 
rently popular term which, in reference to project operations, 1s con- 
ceptually equivalent to efficiency is “cost-effectiveness.” Two or more 
operations, in theory, may be equally effective for achieving a specified 
goal, but one may be more efficient, ie., capable of achieving that goal 
with less expenditure of available resources. 


Numerous questions may be asked regarding the cost-benefits of 
various SEARCH operations. For example, given the immediate goal of 
creating a self-renewing system, is it more cost-effective to concentrate 
upon the development of communication skills, problem solving skills, 
educational innovations, formal organizational structures, some other al- 
ternative, or an optimal mix of several of these “independent variables?” 
Secondly, given the goal of providing increased educational opportunity 
which is more cost-effective: (a) soliciting the participation of the con- 
sumer in program planning or, alternatively, (b) establishing programs 
arbitrarily based upon expert advice? With regard to the latter question, 
we wholeheartedly concur with Gephart (1971) when he suggests that the 
analysis of costs? and benefits will differ depending upon the level of 
decision-making to be served. Since a basic value assumption under- 
lying Project SEARCH is that community involvement in the educational 
decision-making process is desirable, it follows that the costs and benefits 
of various policy alternatives must be assessed from the individual and 
community perspective as well as, if not instead of, the perspective of 
the established educational institution. 


Efficiency or cost-effectiveness evaluation is continuously required if 
we are to assess the relative merits of traditional programs vis-a-vis 
proposed innovations. Faced with the possibility of “future shock” arising 
from a pace of change with which we cannot cope, we may deliberately 
choose to conserve some of our traditional programs and services. It is 
the task of evaluation research, however, to inform us of the cost of 
doing so. 


The Professional Development of Evaluators 


Our experience in the evaluation of Project SEARCH has led us to 
conclude that evaluators of social services or development projects must 
acquire skills beyond those traditionally considered relevant and neces- 
sary to the conduct of basic research. 


2 In this context, the term “cost” is used in its broadest sense to include the surrender of anything valued 
by man whether it be material, social, or personal. 
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At minimum, those engaged in evaluation must be prepared to develop 
and rigorously adhere to a professional code of ethics. Under somewhat 
humorous categories, Suchman (1967) lists several forms of evaluative 
“abuse” (ie., unethical practice). The eye wash, for example, is a biased 
evaluation which reports only those aspects of a program which make it 
“look good.” The white wash diverts attention from program failure by 
soliciting “testimonials” from selected converts. The submarine is an at- 
tempt to destroy a program completely in order also to “sink” both the 
project and its personnel who may have been uncooperative or a source 
of constant clash for power or prestige. The pose is an effort to provide 
the style, if not the substance, of scientific respectability. In the latter 
regard, once again, it must be emphasized that an evaluation design, of 
necessity, will often fail to satisfy the cannons of scientific rigor. Al- 
though the evaluator must be sufficiently flexible to make necessary com- 
promises or trade-offs it is incumbent upon him, nevertheless, to openly 
acknowledge the limitations of his evaluation procedures, his findings, 
and the recommendations, if any, which he is prepared to make. 


Since the major purpose of evaluating any project or service is to 
provide valid information for future decision-making, evaluation must 
strive to be informative rather than merely judgemental. If evaluation 
research is to serve the growing demand for useful information upon 
which to base social-policy decisions, it must grapple with socially relevant 
and therefore value laden questions. Furthermore, it must do so in a 
credible way. In order to achieve and mantain credibility, evaluators must 
be willing to make explicit the value assumptions which underly their own 
efforts. Moreover, they may well consider the possibility of exploring and 
reporting the side effects or unanticipated consequences of a particular 
course of action from the perspective of the diverse value orientations 
held within a pluralistic society. 


Finally, but of critical importance, is the human relations aspect of 
evaluation research. If the evaluator is to establish dynamic working re- 
lations with service or project personnel, who understandably may be 
somewhat apprehensive regarding the prospect of evaluation, but who 
ultimately must make effective use of evaluative inputs, he must develop 
those skills of communications and interpersonal relations which permit 
him to do so. Our experience in the evaluation of Project SEARCH leads 
us to suggest that human relations training may be quite as important 
for the professional development of the evaluator as, say, statistics and 
research design for the professional development of the counselor. The 
evaluator, especially he who purports to conduct formative evaluations, 
has no option but to develop competence in both scientific methodology 
and interpersonal communication. 


References 
Editors of Education USA. Accountability: The new “in” word. ATA Magazine, 
Sept.-Oct., 1970, 9-11. 


Ellis, A. Emotional disturbance and its treatment in a nutshell. Canadian Coun- 
sellor, 1971, 5, 168-170. 


241 


L. W. West 


Gephart, W. J. Decision levels: a neglected factor in cost-benefit analyses. Education 
Technology, 1971, 11(9), 60-61. 

Glaser, R. Instructional technology and the measurement of learning outcomes, 
some questions. American Psychologist, 1963, 18, 519-521. 

Guba, E. G. The failure of education evaluation. Educational Technology, 1969, 
9(5), 29-38. 

Hallworth, H. J., Gallo, J.. Herman, A., and West, L. W. Experiments with a 
vocational counselling system on a small time-shared computer. Unpublished — 
paper presented by Hallworth, H. J. at 17th International Congress of Ap- 
plied Psychology, Liege, Belgium, July, 1971. 

The Human Resources Research Council Act. Revised Statutes of Alberta, Chap. 
177 (1967, c. 36, S. 1), Edmonton: Queen’s Printer. 

Ingram, E. J. Project SEARCH (Project 501 — Selection of educational alternatives 
for rural change). An unpublished paper presented to the Human Resources 
Research Council, 1969. 

Ingram, E. J., and West, L. W. A review of educational opportunity in Alberta, 
1970. Edmonton: Alberta Human Resources Research Council, 1971. 

Lortie, D. The cracked cake of educational customs and emerging issues in evalua- 
tion. (CSEIP Occasional Report No. 19). Los Angeles, University of California, 
1968 (Ed 036 875). 

MacKay, D. A. Project SEARCH, baseline studies. An unpublished research study 
commissioned by the Human Resources Research Council, 1970. 

Popham, W. J. (Ed.) Criterion-referenced measurement, an introduction. Engle- 
wood Cliffs, New Jersey: Educational Technology Publications, 1971. 

Roberts, W. G. A memorandum from SEARCH Project Head to the Coordinator 
of Education Studies of HRRC, Sept. 1970. 

Silvern, L. C. Logos: A system language for flow chart modeling. Educational 
Technology, June, 1969, 18-23. 

Skinner, B. F. Humanistic Behaviorism. The Humanist, 1971, 31(8), 35. 

Stake, R. E. An emerging theory of evaluation. Paper presented at the AERA annual 
meeting, New York, Feb. 23, 1967. 

Stufflebeam, D. L. Toward a science of educational evaluation. Educational Tech- 
nology, 1968, (14), 5-12. 

Suchman, E. S. Evaluative research. New York: Russell Sage Foundation, 1967. 

Toffler, A. Future shock. New York: Random House, 1970. 


242 


The Alberta Journal of Educational Research 
Vol. XVII, No. 4, December, 1971 


F.D.OLIVA 
The University of Calgary 
and 


Head, IPI Project 
Human Resources Research Council 


Demonstration and Testing of Individually 
Prescribed Instruction 


The Individually Prescribed Instruction Project was designed to focus on 
one aspect of HRRC’s program on individuality. Materials developed for 
individualized instruction in mathematics by the Learning Research and 
Development Center at the University of Pittsburgh and by Research for 
Better Schools, Inc., are being field tested in three Alberta schools located 
in three different school systems, two urban and one rural. The terms of 
the contracts between HRRC and the three school systems, some prere- 
quisites for success, and the characteristics of IPI are discussed in this 
article. Specific attention is given to cost factors and other considerations 
in the implementation of Individually Prescribed Instruction. 


The general purposes of the Human Resources Research Council were 
interpreted by Downey (1968, pp. 4-5) to include: 


1. the conduct, or sponsorship, of basic research designed to fill gaps 
in existing knowledge in appropriate domains; 

2. the collection, codification, interpretation and dissemination of avail- 
able knowledge for use by policy makers and others; 

3. the development of plans, materials and processes for use by practi- 
tioners in fields related to human resources development or con- 
servation; 

4. the design and monitoring of programs of change; 

5. the encouragement and support of training programs for researchers 
and developers in appropriate areas; and 

6. the informing of all citizens of emerging trends and problems in 
the area of human resources development and conservation. 


All of these objectives, and their corresponding research and develop- 
ment activities, are summarized in the following figure. 
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I. II. Il. IV. 


Development Adoption 


Diffusion 


Discovery of Creation of new Informing Implementing 
new knowledge inventions potential users new practice 
Theoretical Designing Codification Assessing 
Experimental Controlled Reporting resistance 
Empirical testing Demonstrating Retraining 
Field testing Involving Installing 
Monitoring 


Figure 1. Research and Social Innovation 


In accord with the basic components of research and social innovation, 
HRRC organized its operations into two major areas: (a) Planning and 
Policy Studies, and (b) Research and Development Studies. All of the 
studies in the R and D area were in the field of education. These were 
categorized under two major programs: (a) Studies in School Community 
Development, and (b) Studies of Individual Development. 

Program Area 400: Individuality was envisioned as a comprehensive 
research and development program addressing questions related to the 
development of individuality in a variety of ways. The program emphasized 
the development of children and youth—in particular, the school experience 
of these age groups. 

The nature of individuality itself was a major question raised for con- 
sideration. Although knowledge about individuality and the applied aspects 
of it was very limited, the assumption was made that relationships can 
be uncovered between such qualities as capacity for self-direction and 
willingness to assume responsibility on the one hand, and certain con- 
ditions prevailing in the lives of children and youth on the other. The 
conditions of schooling, in particular, were of interest to the staff. Much 
of the proposed program was devoted to research and development pro- 
jects pertaining to the conditions of schooling as they related to the 
development of individuality. Considerable attention was given to 
planning programs for exploring means for individualizing learning. 


Focus and Design of the IPI Project 

Initially, the Program on Individuality consisted of four research and 
development projects which were as follows: 

401. Baseline Study: Conditions of Schooling Related to Individual 

Development; 

402. Individually Prescribed Instruction; 

403. Studies on the Nature of Individuality; 

404. Computer-Assisted Instruction. 
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The rationale, objectives, anticipated outcomes, research activities and 
staff capability required for Project 402 (Individually Precribed Instruction) 
were briefly described in the initial Prospectus (Downey, 1968, pp. 35- 
36) as follows: 


Rationale 


The Learning Research and Development Center at the University of 
Pittsburgh initiated work on Individually Prescribed Instruction (IPI) 
systems some years ago. In recent years, their efforts have been sup- 
plemented by Research for Better Schools, Inc., (RBS) a non-profit 
regional educational laboratory sponsored by the U.S. Office of Education, 
which field tests, evaluates, and modifies IPI systems. Of the work carried 
out to date under the research and development center program of the 
U.S. Office of Education, IPI systems are the most advanced. 

Since the major work on IPI systems had been with mathematics and 
reading programs at the elementary level, it was with these systems 
that the Council’s IPI project would begin. Developmental work in educa- 
tion requires such a high level of expenditure that collaborative activities 
with other R and D centers would seem to be essential as a matter of 
policy. The collaborative work proposed would be the first expression 
of this policy. 


Objectives 


Initially, the objectives set out for the project were: 

1. To establish one or more demonstration/testing centers for IPI 
materials; 

2. To undertake further developmental work with IPI systems in co- 
Operation with the Learning Research and Development Center (Uni- 
versity of Pittsburgh) and Research for Better Schools, Inc. (Phila- 
delphia, Pennsylvania); 

3. To assess the applicability to Alberta schools of developed IPI sys- 
tems; and, 

4. To disseminate research and development findings on IPI systems 
to educators throughout the province. 


Anticipated Outcomes 


In addition to the findings implied by the project objectives, the fol- 
lowing outcomes were anticipated: 


1. An early start (involving modest expenditures) in research and 
development activities leading to the creation of tested educational al- 
ternatives for use in Alberta schools. 

2. Establishment of working relationships with other R and D centers 
in studies of mutual interest which can accelerate development of Council 
programs. 


Research Activities and Staff Capability Required 


Five major phases of the project were conceptualized as follows: 
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Phase 
I—to April, 1969 


II—to September, 


1969 


III—to April, 1970 


IV—to April, 1971 


V—to April, 1972 


In order to carry out the objectives of the IPI Project, contracts were 
negotiated with three school systems. The three school systems were the 
Edmonton Public School District, the Calgary Separate School District, 
and the Foothills School Division. During the early months of 1969, three 
experimental schools and three control schools were selected. The urban 
sample was selected, in part, on the basis of the socio-economic status 
of the community. The schools ultimately chosen, in consultation with 


Activities 


Recruit project coordinator and 
staff and begin negotiations with 
cooperating school systems; negoti- 
ate agreement with RBS for testing 
and development of IPI systems. 


Summer training institute for teach- 
ers in the demonstration/testing 
schools; further development of 
IPI systems; develop evaluation 
design for appraisal of the IPI 
systems undergoing test. 


Testing and development work; de- 
cisions as to the scope of the second 
year’s operation. 


Testing and development’ work; 
dissemination of findings from the 
first year of operation,; decisions 
as to scope of the third year’s 
operation. 


Project evaluation; decision as to 
whether the project should enter a 
second phase or should terminate; 
dissemination of findings. 


central office administrators, were as follows: 


System 


Edmonton System 
(Lower Socio- 
Economic Sample) 


Calgary System 
(Higher Socio- 
Economic Sample) 


Foothills Division 
(Rural Sample) 


. When schools were tentatively identified for participation in the Pro- 
ject, teachers and administrators were informed as fully as possible about 
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Experimental Schools 


Forest Heights School 


Staff 


Core staff of 
Council 


Project coor- 
dinator 
Administrative 
assistant 
Research/Develop- 
ment Team (4) 
Principals and 
teachers (2- 
week summer 
Institute) 


Staff as shown 
above 


Staff as necessary, 
given decisions 
as to the scope 
of the second 
year project 


Staff as necessary 


Control Schools 


Princeton Elementary 


School 


St. Vincent de Paul 
School 


Millarville School 


St. Leo’s School 


Red Deer Lake School 
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IPI. Teachers who did not wish to take part were given the option of trans- 
fering to another school. Out of a possible total of thirty-three teachers, 
five chose to transfer to other buildings, although none of these did so 
because of IPI. 


In the original contracts with the three systems, HRRC agreed to under- 
write the cost of: 


1. consultant services; 


2. all prepared instructional materials for the mathematics program; 
Grades 1-6 (approximately $12.00 per student each year); 

3. a two-week retraining workshop for the principals in Seattle, Wash- 
ington; and, 

4. a two-week retraining institute for the teachers in Banff, Alberta. 


As part of their contribution, the school systems were expected to 
assume responsibility to: 


1. provide a control school and an experimental school, along with the 
corresponding students, staff and storage facilities for instructional 
materials; 


2. supply the appropriate number of teacher-aides; and, 


3. free the principal for a two-week period in April so that he would 
be able to attend an administrators’ retraining workshop. 


In summary, then, the applications from the three school systems and 
the design of the IPI development project were based on five criteria: 


1. Administrative Commitment—The school board, a central office ad- 
ministrator and the principal should have a thorough, first-hand knowl- 
edge of the essential elements of IPI Math. They should also be fully 
informed of the administrative requirements of the program. 

2. Teacher Commitment—Teachers must be involved in the selection 
of IPI Math for their school to insure the high level of teacher commitment 
which is so important to the success of the program. This should include 
thorough briefings on the elements of IPI and its implications. 

3. Need for Retraining—There is a significant need for both adminis- 
trator and teacher retraining when a school adopts IPI Math. The school 
system should be fully aware of the nature and extent of this retraining. 

4. Research Participation—Both administrators and teachers should 
know in detail the research questions that are being asked, the kinds of 
data that will be collected, the method of data-collection, and the work 
involved in that operation. They should also be aware of the need for 
attitude surveys to be conducted with both teachers and students, the 
possible request for additional achievement testing, and other contingenc- 
ies which make demands on school personnel. 

5. Uniqueness of Situation—This involved consideration of the in- 
dividual school history. Is the school ready for individualization? Has the 
school been involved in innovation? Has it attempted in any way to pre- 
pare for individualized instruction? Does the school present a suitable 
climate for Individually Prescribed Instruction? 
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Characteristics of Individually Prescribed Instruction 


The principal goal of education is to create men who are capable of 
doing new things, not simply of repeating what other generations have 
done—men who are creative, inventive, and discoverers. The second goal 
of education is to form minds which can be critical, can verify, and not 
accept everything they are offered. The great danger today is of slogans, 
collective opionions, ready-made trends of thought. We have to be able to 
resist individually, to criticize, to distinguish between what is proven, and 
what is not. So we need pupils who are active, who learn early to find 
out by themselves, partly by their own spontaneous activity and partly 
through materials we set up for them. .. . (Elkind, 1968, p. 80). 


The above quotation from Jean Piaget adequately describes the broad 
goals of Individually Prescribed Instruction. In order to bring about such 
behaviors in students, the developers of IPI—Glaser, Bolvin, and Lindvall 
of the University of Pittsburgh—have attempted to use information about 
individual differences in order to prescribe appropriate educational en- 
vironments. 


Individually Prescribed Instruction is an instructional system based on 
a set of behavioral objectives which are correlated with diagnostic instru- 
ments, curriculum materials and teaching techniques (Scanlon and Bolvin, 
1969, p. 5). It represents one specific way of providing for the wide 
ranges of differences which exist in classrooms. Certainly it typifies what 
can be done to help students progress at their own rates and in their own 
program of studies. 

In its present stage of development, the objectives of the IPI Program 
are: 


1. To enable each pupil to work at his own rate through units of study 
in a learning sequence; 


2. To develop in each pupil a demonstratable degree of mastery; 
3. To foster the development of problem-solving thought processes; 
4. To develop self-initiation and self-direction of learning; and, 


5. To encourage self-evaluation and motivation for learning (Scanlon 
and Bolvin, 1969, p. 5). 


With respect to the first objective, provision must be made for: 


1. Differences in level of achievement among students within a given 
class. This requires that the system be structured so that teachers can 
determine what each child knows in each area of the curriculum. 


2. Differences in rate of learning toward specific goals in the curriculum. 
In the elementary school, particularly, there is a set of learning goals that 
is Common to approximately all students. In order to maximize each pupil’s 
rate of achieving these goals, it is necessary to restructure the materials, 
the techniques of instruction and the learning settings. Hence, the system 
has to be adaptable to at least the gross learning styles of the students. 


3. Establishing different learning goals for different students. In the 
upper levels of the elementary program, the determination of which goals 
to establish for which student requires a joint decision of the child and 
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the teacher depending upon the child’s past experiences, achievement, 
and the structure of the subject matter. 

Closely related to the first objective is the goal of mastery of subject 
matter. The assumption is that most children can master their subjects 
if the instructional environment can adapt to their requirements. Mastery, 
in the IPI program, is defined as a specified proficiency level for a given 
objective plus a specified. retention level over a longer period of time. 
This concern for mastery means that provision must be made for various 
amount and kinds of practice, various amounts of time to achieve mastery, 
and various instructional techniques. 


The development requirements (Bolvin and Glaser, p. 830) to meet 
these objectives can be thought of in terms of six elements which disting- 
uish IPI from conventional school procedures: 


1. Detailed specification of educational objectives. The outcomes of 
learning are specified in terms of observable competence and the con- 
ditions under which they are to be exercised. Vague specifications of de- 
sired outcomes leaves little concrete information about what the educa- 
tional process should strive to attain. Interaction between the specifica- 
tions of outcomes in relation to instructional procedures provides a basis 
for redefining the objectives. There is a sustained process of clarifying 
goals, working toward them, evaluating progress, re-examining the ob- 
jectives, modifying instructional procedures, and clarifying the objectives 
in light of evaluated experience. Ideally, this process should highlight 
the inadequacies in a program. 


2. Organization of methods and materials to attain these objectives. 
Alternative instructional procedures are selectively assigned to the student 
or made available to him for his selection. In many respects, the ma- 
terials are the key to providing an individualized program that is both 
workable and economically feasible. They have to be developed, in keep- 
ing with subject matter requirements, for some degree of self-study. 
Without this option available, the amount of teacher help needed would 
be unmanageable. For this reason, the emphasis to date in the IPI Pro- 
gram has been in the development of materials that can be self-instructional. 


3. Careful determination of each pupil’s present competence in a given 
subject. Without careful assessment of initial learner characteristics, 
carrying out the educational procedure is presumptuous. The diagnosis 
of the initial state includes not only assessment of the learner’s knowledge 
of prerequisite behavior but also the assessment of his aptitudes, his 
learning style preferences, and his perceptual and motor skill capa- 
bilities. This accumulated diagnosis must be especially relevant to the 
immediate instructional step that is to be taken. 


4. Individual daily evaluation and guidance of each pupil. 


5. Provision for frequent monitoring of student performance in order 
to inform both the pupil and the teacher of progress toward an objective. 
As the student proceeds to learn from the instructional procedures made 
available to him, his performance is monitored and continuously assessed 
—at short or long intervals, appropriate to what is being taught. 
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6. Continual evaluation and strengthening of the curriculum and in- 
structional procedures. The system has inherent in its design the capa- 
bility for improving itself in that it provides a cumulative bank of knowl- 
edge on which improvements can be made. 

The special characteristics of IPI are depicted in Figure 2 (Scanlon, 
1970, p. 45). 


INSTRUCTIONAL RESOURCES 


Educational Objective Diagnostic Instruments 


1. Four types of achievement 
tests for each objective. 

2. Teacher judgment to assess 
learner’s characteristics. 

3. IPI record system. 


1. Range of educational 
objectives. 

2. Behavioral objectives. 

3. Carefully sequenced. 

4. Mastery requirement. 


TEACHER 


1. Learner-oriented. 
. Guides learning. 
. Requires at least 
85% mastery of 

objective. 


C to 


Materials and Equipment 


1. Matched to each objective. 
2. Various kinds. 
3. Self-instructing. 


Teaching Techniques 


1. Learning Settings 
a. Variety of arrangements 
of students ranging 
from independent study 
to large group 
instruction. 
b. Formed on basis of 
individua! learning 
needs and characteristics. 
2. Teaching Methods 

a. Variety of methods. 

b. Designed to produce 
maximum interaction 
between student and his 
Prescription. 


. Self-directing 
2. Assumes responsibility 
for learning. 


. Accepts mastery 
requirements of 85%. 


STUDENT 


Instructional Time 


1. Pacing: Individual rates 
of progress through the 
continuum. 


Figure 2. Special Characteristics of IPI 


Four types of diagnostic instruments are used in IPI. These in- 
clude placement tests, pre-tests, post-tests and curriculum-embedded tests. 
Placement tests are administered at the beginning of each academic year 
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to determine general placement of each pupil in each subject-matter area. 
The information obtained from the placement test shows whether the 
student gained, lost, or retained the proficiency he showed at the end of 
the previous school year. 


A second set of instruments used, the pre-tests, measure each of the 
objectives within a particular unit. Mastery of any of the objectives, as 
indicated on the pre-test, means that the child can skip these particular 
objectives and concentrate on those objectives which he has not yet 
mastered. 

Post-tests and curriculum-embedded tests are also used to assist the 
student and the teacher in making decisions as to when the child is 
ready to move to the next learning tasks. The curriculum-embedded 
tests are short check tests embedded within the materials for each ob- 
jective, while the post-tests are alternate forms of the pre-tests given at 
the end of a unit as a final check for mastery. 


Cost Factors in IPI Mathematics 
During the initial year of operation, 1969-70, the cost of IPI materials 
supplied by Research for Better Schools was $12.00 per student. 


In the second year of operation, 1970-71, the following variable scale 
was introduced, which was dependent on pupil enrolment: 


0- 99 students $11.00 per student 
100-199 “4 10.50 4 
200-299 “ 10.00 ‘ 
300-399 + 9.50 Hf 

over 399 “ 9.00 # 


Informal indications are that costs can be expected to become still 
lower in the next few years, for two basic reasons. First, the initial 
period of program development, with its enormous associated costs, is 
virtually over. Second, the IPI mathematics ‘package’ appears likely to 
be turned over to Appleton-Century-Crofts Publishing Company for com- 
mercial production in the near future. 

Whether these factors alone can bring the costs of IPI mathematics 
into line with prices of existing mathematics textbook series remains to 
be seen. 

The costs described so far, however, represent only a part of the total 
financial commitment necessary for the implementation of IPI mathe- 
matics. RBS provides the following example of a typical budget for a 450 
student, 18 room elementary school entering IPI mathematics: 


Training: 

Administrative per diem 10 days x $30/day $ 300.00 
18 teachers x 2 weeks x $150/week 5,400.00 
Teacher materials 18 x $10 180.00 
Teacher-aide materials — % Aides x $5 25.00 


Sub-total $5,905.00 
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Teacher-Aides: 

5 aides x $3,000/annum 15,000.00 
Planning Time: No additional staff needed 
Student Materials: 450 x $10 4,500.00 
Shelving: 500.00 


Grand Total $25,905.00 


Experiences in the HRRC IPI Pproject to date have indicated certain 
modifications to the RBS (Research for Better Schools) budget description 
are possible. 


The Administrative Training Program is a definite commitment, and 
the cost indicated is reasonably accurate. However, teacher training 
can be accomplished in any number of ways, depending upon the situation 
and the resources available. An intensive training program conducted a 
few days before the beginning of school would probably be adequate, if 
that is all that time and resources allow. Obviously, the more experience 
teachers have with IPI, the more confidently they will be able to deal 
with their classes but the suggested two week training period seems liberal 
in any case. 


The $10.00 per teacher cost associated with teacher materials refers 
to the teacher training manuals (6 volumes in 1969-70) which are sent to 
each prospective IPI teacher. This cost is compulsory, as is the related 
cost of teacher-aide materials, which consists of a training manual, along 
with a record-narrated filmstrip. 


RBS suggests that one teacher-aide be employed for every 75-100 stu- 
dents. While this is a desirable ratio, it is possible to operate the pro- 
gram with few paid aides. One full-time aide seems indispensible, but 
parent volunteers appear to be able to carry the remainder of the load very 
well. In larger elementary schools, particularly, the use of parent volun- 
teers to assist with marking and recordkeeping seems to be a necessity, 
unless an extremely large number of paid teacher-aides can be employed. 


The cost of student materials is also a very flexible item. In distributing 
IPI materials, RBS provides only programmed paper and pencil materials 
in work-book format. Any manipulative aids or other mathematical ma- 
terials must be provided by the school. As in any mathematics program, 
certain supplementary mathematics materials have been found neces- 
sary for effective implementation. It should be added that two expenses 
which are peculiar to IPI will have to be included in the cost of ma- 
terials. One is the cost of some form of portfolio folder for each student 
to carry his mathematics materials. The other is some form of “tote 
box” to carry the students’ math folders. Neither item need be extremely 
expensive, but nonetheless is worthy of consideration. 

The final item mentioned in the sample budget, shelving, is once again 
a flexible one. All that can be said with certainty is that some form of 
storage space will be required; ideally it will take the form of low, ac- 
cessible shelves, from which students can readily draw their own materials, 
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or, as in the case of one of the project schools in Alberta, filing cabinets 
have been used. For a 15-20 room elementary school, the equivalent of an 
entire classroom is ordinarily required for the storage of adequate quan- 
tities of the approximately 485 different booklets used in the program. 
The $500.00 figure for shelving is a realistic one, covering the cost of 


constructing adequate wooden shelves designed specifically for the storage 
of IPI materials. 


In addition to the costs described by RBS, other costs, peculiar to 
Canadian participants, are worth mentioning. Two relatively small, but 
inevitable expenses, are postage costs and customs charges. Postage 
must be paid for all materials sent to Philadelphia—the most expensive 
of which involve the shipment of sample forms and materials required as 
part of each school’s research commitment to RBS. Charges associated 
with customs clearance, for example, brokerage fees, will be incurred 
every time a shipment of materials is received. Apart from these in- 
stances IPI materials are shipped totally pre-paid, so that no shipping 
expenses should be involved. 

The final cost consideration is also an optional one, and it relates to 
the curriculum materials themselves. Because the materials are American, 
the money units—which occur at nearly every level—contain pictures of 
American coins and bills. This, coupled with the fact that the reproduction 
of the coins was very inadequate, motivated HRRC to undertake a ‘“Cana- 
dianization” of the IPI money units containing pictures of American money 
for the three project schools. This activity cost approximately $400.00, 
and involved the multilith reproduction of 22 booklets, in adequate quan- 
tities for all three schools. 

In summary, it may be said that IPI is an innovation based on research 
which uses current information to improve its techniques, procedures and 
materials. Hopefully, this report will add to the growing number of 
publications which are attempting to disseminate information about IPI 
systems. 
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Evaluation of The IPI Project 


The evaluation of the IPI mathematics project in three Alberta schools is 
described. Data were collected on student achievement, student attitudes, 
teacher attitudes and parents’ opinions. In a comparative study of student 
achievement, the results tended to favor the set of Control schools. In areas 
of student and teacher attitudes the reverse was true. Parental opinions 
were found to be generally favorable to the program. Project administrator 
reports are described and implementation problems are discussed. The pre- 
sent paper is a much-shortened form of a report presented to the Alberta 
Human Resources Research Council. 


In the spring of 1969, three schools were selected as sites for the esta- 
blishment of demonstration/testing centres for IPI Mathematics. Two 
urban schools were selected as representative of two broad socio-economic 
classes. One of the schools served a predominantly lower middle class 
neighbourhood while the other urban school was located in an upper middle 
class area. A third school was selected to represent the rural situation. The 
three school systems in whose jurisdiction the demonstration schools fell 
were asked to nominate a second school which most nearly matched the 
demonstration school in terms of facilities and area served. In the report 
that follows, these schools will be referred to as Control schools, although 
it is important to realize that from an experimental point of view, they could 
not be considered as equivalent to the IPI schools in any more than a 
general way. 


In September of 1969, IPI mathematics was installed in the three IPI 
schools. As the project developed the major emphasis was placed on the 
third objective. In line with this, the evaluation activities were also con- 
centrated on investigating the applicability of the IPI Mathematics system 
to Alberta schools. To this end, during the first year the evaluators under- 
took to examine IPI mathematics from two points of view, process and 
outcome. 
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Two broad procedures were used in the evaluation. Comparisons were 
made between the IPI and Control schools on many of the variables. In ad- 
dition, and perhaps more importantly, observations, opinions and judgements 
were elicited from students, teachers, parents and administrators in the IPI 
schools. 

Achievement data, and some attitude data were collected in October of 
1969, and again in May of 1970, in an effort to detect changes that might 
have occurred during the first year of the project. Interviews with teachers 
and parents were made during February of 1970, after they had a chance to 
get by the initial disruption of installation, and had experienced enough of 
the program to form valid opinions. All of the results presented in this report 
refer to the first year of the project. 


Process Evaluation 


Two kinds of processes were involved in the IPI Project. The first process 
consisted of the installation of IPI in the schools. The data concerning this 
process were the observations and opinions of two of the administrators who 
had responsibility for running the program. A qualitatively different kind of 
process was investigated by looking at the activities in the classroom them- 
selves. A comparative study of the teacher-student interactions was made to 
see if any differences in classroom processes were detectable. 


Evaluation of Program Implementation 


Pacey (197la) and Holmes (1971), two of the administrators involved in 
the implementation of IPI, maintained sets of notes describing the problems 
and successes that were encountered in the application of IPI during the 
first year. From their reports, several interesting results were noted. 


During the first month of operation, all of the children had to be placed 
on the IPI continuum. This required the testing of all of the children to deter- 
mine the level at which they should enter the program. The procedure proved 
to be tedious and often exhausting, but since complete placement testing is 
only required when the program is first introduced to the school, the task was 
a bearable one. In succeeding years, September placements for most 
students can be made on the basis of their June locations on the continuum. 


Also, in the first month, the schools needed extra help in carrying out the 
many tasks of recording, prescribing, testing, marking, and distributing ma- 
terials. Because the teachers were not yet intimately familiar with the ma- 
terials, more than the usual help was needed. The school administrators spent 
a considerable amount of time in the classroom working with the teacher and 
students in an effort to alleviate the problem. This not only provided the 
extra manpower necessary to overcome the initial starting pains, but had the 
side effect of promoting a spirit of unity among the staff. 

Because of the magnitude of the individualization task, the first month 
was particularly inefficient for the students as well. Some students spent as 
much as three quarters of their time standing in line, waiting to have materials 
corrected or assigned. Two solutions to this problem were used. The children 
themselves were given more responsibility in marking their own work, and 
obtaining materials from the storage rooms. Secondly, since the city schools 
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obviously needed more teacher assistance for the clerical chores, parent volun- 
teers were obtained from the communities. Typically two volunteers were used 
in each math class. 


Among the other initial difficulties was the problem of the placement tests. 
Children who had grown accustomed to the traditional purposes of testing, 
often had difficulty accepting “failure” in placement testing. However, after 
a month’s experience with the program, their understanding of the role of the 
placement test allowed them to see it in its proper perspective. 

The administrators of the IPI program in each school were trained at a 
demonstration school in the United States. At that school, the IPI guide- 
lines were rigidly adhered to. Within the Alberta situation, no attempt was 
made to follow the guidelines exactly. The teachers of each school tried to 
fit the program into the contexts of their own situation. In grade one for 
example, one school used the IPI materials from the outset, but used addi- 
tional mathematics readiness materials at the same time. At another school 
the children in grade one were phased into the program in three groups as 
they became ready. In general the teachers tried to follow the IPI program, 
but felt free to deviate from the enunciated procedures whenever their pro- 
fessional judgement dictated it. 


The effects on the children, as observed by the administrators was im- 
portant. Almost all of the children were excited by the program. Undoubtedly 
some of this could be attributed to the novelty of the program, but that is 
not necessarily a bad thing. There were no new discipline problems caused 
by the increase in freedom, and some of the old problems (a few of the so- 
called lazy children) seemed to disappear. Some of the children were be- 
wildered and frustrated by the complex system, but the number was not nearly 
as many as the staff had expected. The vast majority of the students adjusted 
quickly and enjoyed their work so much that they were reluctant to be taken 
out of their booklet work to work on some enriching activities in seminars. 
There seemed to be a lingering competitiveness that made some of the children 
push to keep ahead of their friends. 


For the teachers, the work at the beginning was hard. Later, as they be- 
came more accustomed to the system, they began to sense a different kind of 
problem that was caused by the IPI system. In traditional group teaching 
situations, individual learning problems are often overlooked in the attempt 
to achieve some overall mastery by the majority of students. In IPI, the 
problem does not go away as the student moves from one topic to another, 
because he cannot move until he has achieved the goal. As a result, teachers 
were forced to deal with individual learning problems and were astounded by 
the complexity of the learning process. Despite the difficulties, the teachers 
were generally positive in their feelings toward the program, although they 
were critical of many of the specifics of the curriculum. 


Five general problems were detected by the administrators. 


1. The curriculum materials that were used to teach the money units, all 
used American coinage; these units were changed to fit the Canadian scene. 


2. The project was plagued with problems in shipping, both in terms of 
late shipments, and improperly filled orders. 
3. There were many printing errors in the materials and answer keys. 
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4. the units designed for the first grade students, required a greater ability 
to read than most students possessed. 

5. Uncertainty in the organization of the funding agency was disruptive of 
morale in the schools. 

In the minds of the participant-observer administrators, these five problems 
were more than compensated for by the enthusiasm of the learners and 
teachers. 


Classroom Interaction Evaluation 

Some critics of IPI suggest that because of the individualized nature of 
the program, the children loose valuable opportunities for developing social 
skills. In an effort to determine what differences in classroom interactions 
existed between the programs, Pacey (1971b) carried out a comparison of 
the verbal behavior patterns in the experimental and control schools using the 
Flanders method. 

All teachers in grades three to six in all six schools were observed for 
twenty minutes each. In all there were 16 hours of observation time. The ob- 
servations were made in March and April of 1970. 


The analysis of the interaction matrices indicated several differences be- 
tween the two groups. The results were summarized by Pacey as follows: 


1. More information was provided directly by the teacher in IPI. Closer 
examination revealed that this tendency was general throughout the matrix. 
That is, IPI teachers tended to precede and follow student talk with their 
own thoughts and opinions more than did teachers in the control group. There 
was no other significant build-up elsewhere, for example, use of extended 
lecture was about the same in both groups. This indicated that rather than 
taking time to build on student ideas, IPI teachers tended to explain 
answers quickly and move on, which may suggest that the IPI system is 
rushing .eachers. 


2. IPI teachers made less use of questioning. The pattern for this is con- 
sistent with number one. These two differences would seem to be significant 
because the IPI system claims that teachers should avoid telling students 
answers, but rather should encourage them to discover answers for them- 
selves, by leading them there via careful questioning. 


3. There was substantial increase in student talk in the IPI group, especially 
student-initiated talk. This is certainly, at least in part, due to the system, in 
which students come to the teacher for assistance or guidance, usually at their 
own initiative. But careful analysis of teacher reaction to student talk indicated 
that the teachers in the IPI group seemed to encourage it. 

4. Related to increased student talk was the dramatic increase in extended 
student talk. When a student began talking to the teacher, he was allowed 
to talk for sustained periods of time more frequently in the IPI group than 
in the Control group. 

5. A significant increase was evident in the use of motivating and encour- 
aging teacher behavior in the IPI group. Although use of these behaviors 
was not very extensive, it was higher than in the Control group. This, of 
course, may be due to differences between the schools, but it might also be 
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attributable in part to the IPI system, which allows one-to-one interaction on 
a far greater scale than normally. 


6. There was a corresponding decrease in the use of controlling teacher 
behaviors in the IPI group. That is, IPI teachers tend to give directions and 
criticism less often than did the Control teachers. The IPI system would seem 
to account for the decrease in giving directions, since the materials do much 
of that. The decrease in criticism might be partly attributable to the system, 
which is success-oriented and gives students a fair amount of freedom. 


7. There was less use of extended indirect teacher behavior in the IPI 
schools than in the Control schools. This may suggest once again that teach- 
ers do not have enough time to adequately develop and encourage student 
ideas and feelings. 

Because IPI had only been in the schools for six or seven months at the 
time of the observations, the study was viewed as exploratory in nature. 


Outcome Evaluation 


The outcomes of the program were examined in two ways, comparatively, 
and judgmentally. Two general kinds of effects were investigated, achieve- 
ment, and attitude. The attitude effects were investigated with students, 
teachers, and asample of parents. 


Comparative Study of Student Achievement 


In an effort to evaluate student achievement in mathematics in a com- 
parative way, two subjects of the Canadian Tests of Basic Skills (CTBS) were 
administered to the students in grades 3, 4, 5 and 6 in the IPI and Control 
schools. The CTBS is a version of the Iowa Tests of Basic Skills adapted for 
use in Canadian schools. The two subtests used in the evaluation were Arith- 
metic Concepts and Problem Solving. These tests were designed to reflect 
the skills and objectives pursued in most existing textbooks. The Arithmetic 
Skills test contains items measuring concepts involving currency, decimals, 
equations, fractions, geometry, measurement, numerals and number systems, 
percents, ratios, and whole numbers. The Problem Solving test includes prob- 
lems that involve the kinds of operations and concepts that generally appear 
in the first half of textbooks for a particular grade. 

The tests were administered in September and May of the first year of 
the program. At each grade level an analysis of covariance was carried out 
on both the Arithmetic Concepts and Problem Solving tests to see if there 
were significant differences in the May means after adjustments were made 
for differences that existed in September. 

The results of the analysis for both tests showed no significant differences 
at grades 4 and 5. For grades 3 and 6, the adjusted mean for the Control 
group was significantly higher than that of the IPI group. 

In all cases, the differences in adjusted averages, did not exceed 2.25 
points. The individual school averages for the May testing were compared 
to the norms for school averages provided by the publishers of the test. These 
norms indicate the percentile points for grade averages when the tests are 
administered after April 1. For the six schools in the study, and four grade 
levels in the study, only two grades of the 24 were below the 50 percentile 
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on Arithmetic concepts, and only five grades were below the 50 percentile 
on Problem Solving. This record indicates that all of the schools seem to 
be doing a remarkable job (in relation to the schools used in the norming 
procedure) in preparing their students in areas measured by the CTBS. Thus, 
even though differences that exist favor the Control group, this should not 
betaken to mean that the results for the IPI group are poor. 


In an effort to determine whether or not there were any differential ef- 
fects of the program for different ability levels, the data were reanalysed 
with the students categorized into ability levels. The Lorge Thorndike Verbal 
and Non-Verbal Intelligence. Scales were used separately to categorize the 
students into three broad intellectual groups. Because the test was admini- 
stered at the same times as the CTBS, it was possible to place students into 
the three groups according to their September and May scores. Only data 
for students whose I.Q. scores fell within the same category on both adminis- 
trations of the test were used in subsequent analyses. The categories were 
defined as I.Q. scores of 95 and below, 96-115, and above 115. Once the 
students had been classified by ability, students from each category were 
selected at random until there were equal numbers of students in each category 
defined by the IPI-Control dimension and the high, medium, low ability di- 
mension. 


In all analyses, the September score on the CTBS scale was used as a 
covariate in an attempt to partial out differences that existed among the 
groups on the September testing. In one way, the analysis is really an analysis 
of gains made over the year. In the analysis, it was expected that the higher 
ability levels would gain more than the lower ability levels so that one would 
expect a significant difference among the ability levels. Differences between the 
IPI and Control groups might also exist as had been noted in the previous 
analysis, although some inconsistencies with the previous analysis might exist 
because of the smaller number of students used in the present analysis. The 
critical test, and the purpose of the present analysis was the test for the inter- 
action between program and ability level. Presence of a significant inter- 
action might indicate the effects of the IPI and Control programs on one ability 
level were different from the effects at another level. 


The results of the analysis showed significant differences among ability 
groups, as expected, and between IPI and Control groups at grades 3 and 6 
as shown previously. There were no significant interactions between ability 
groups and program. Since no interactions were significant, there is no evi- 
dence to suggest that either program is more effective at one level than at 
another. 


Of course, the success or failure of a program cannot rest on a single or 
even two measures of educational achievement. Because the IPI program 
is generally conceded to be an innovation in method and not content, the 
CTBS Scale used seemed appropriate measures for determining gross dif- 
ferences between the IPI and Control schools. However, future evaluation 
should include finer instruments in order to be able to document specific 
differences between the groups. 


Where differences did occur, (at grades 3 and 6), the Control group 
showed superiority. This may be due to a number of factors, each of which 
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must be considered for future evaluation and decisions. While the schools’ 
curricula did not differ greatly in content, the sequence of material may have 
been able to account for the differences that occurred. The IPI sequence may 
have put them at a disadvantage in grades 3 and 6, or, on the other hand, 
the Control schools may have been at a disadvantage in grades 4 and 5. 
Another factor that may have accounted for the results is that the students 
at the different grade levels were different for the two programs. The analysis 
of covariance in the study was used in an attempt to overcome differences in 
CTBS scores that existed prior to the implementation of the program, it cannot 
be expected to make the groups “equal” however. Differences in teachers and 
classroom atmosphere could also have contributed to the results. Finally, it 
is also possible that the IPI program itself is not as strong at grades 3 and 
6 asitis at grades 4 and5. 


Measurement of Student Attitudes 


As one method of collecting information about changes in student attitudes 
over the first year of the program, a Student Questionnaire was administered 
to the students in grades 3 to 6 of the IPI and Control schools in September 
and May, (Maguire, 1971). 

In general, the results of the questionnaire indicated that the students in 
the IPI schools at all grades liked mathematics better than their counterparts 
in the Control schools. A second finding was that more students in the IPI 
schools found mathematics easy, than in the Control schools. Both of these 
findings occurred at September and May which leads one to believe that 
there are additional factors operating beyond the IPI program itself. How- 
ever, since the September administration was made after the children had 
been in school for almost a month, the month’s experience may have caused 
the difference. 


In addition to collecting attitudes toward arithmetic activities an attempt 
was made to evaluate some generalized student attitudes toward their environ- 
ment. In May, a “pupil opinionnaire” developed by the staff at Research for 
Better Schools Inc. for use in their evaluation of student attitudes toward 
IPI was administered. This opinionnaire used a semantic differential format. 
Students were asked to rate eight concepts on 9 five point scales. The eight 
concepts were: 


My School Is 
Being Praised for Doing Something Well is 
My Classmates Are 
Working by Myselfin School is 
My Math Classis 
Being Scolded for No Reason is 
Iam 
Taking a Math Testis 


The nine scales used were: 
smart—stupid 
happy—sad 
easy—hard 
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fair—unfair 
bad—good 
slow—fast 
nice—awrful 
useful—useless 
boring—interesting 


The instrument was administered to all students in grades 3, 4, 5 and 6. 
The responses were made anonymously. Because the instrument was being 
used on a speculative basis, the students were not required to indicate their 
grade level. As a result there were 497 responses in the IPI group and 542 
responses in the Control group. 

The differences between the average ratings of the IPI and Control groups 
were tested for each concept on each scale. In all there were 72 tests carried 
out. 


For the concepts “Being praised for Doing Something Nice’, “Being Scold- 
ed for no Reason”, and “I am”, there were no significant differences on any 
of the scales. For the “My Classmates are” concept, the IPI group rated 
their classmates closer to the smart, fast, and good ends of those scales than 
the Control group. All other scales were not significant. 


The “My School” concept showed significant differences on all scales ex- 
cept hard-easy. The “My Math Class’ concept showed significant differences 
on all scales except useful-useless, where the average rating for both groups 
was next to the useful end of the scale. “Working by Myself in School” was 
significant on all scales except hard-easy and fast-slow. On all of the scales 
on which significance occurred, the IPI group means were closer to the smart, 
fair, interesting, nice, good, happy, easy, fast, useful ends of the scales than 
were the Control means. In all of these cases too the Control group was 
closer to the above ends of the scales than they were to the other end. 

For “Taking a Math Test’, the IPI group rated it closer to the nice, in- 
teresting and happy ends of those scales. There were no significant differences 
on the other scales. 


The interesting findings is that despite the extremely powerful test used 
(the degrees of freedom were over 1,000) not all of the tests produced 
significant results. In tests that involved general concepts such as “Being 
Praised ... and “Being Scolded . . .” no significant results occurred. These 
results suggest that the scale may have some validity and that the IPI children 
are not trying to produce results that merely please. The self concept scale, 
“I am’, also showed no significant scales. The “Classmates” concept only 
showed three significant scales. In general, the concepts involving school ex- 
periences that were different for the two groups did produce significant re- 
sults with the IPI group exhibiting some positive responses. Of course, one must 
note that the Control group responses were not negative. In most cases they 
were only slightly less positive. 

As a result of the two questionnaires, it seemed fair to conclude that the 
IPI program as installed in the three schools of the study tended to produce 
a greater enthusiasm for arithmetic among the students than the Control pro- 
gram did for its students. This enthusiasm does not appear to be blind. On 


questions that do not reflect program characteristics, there appear to be few 
differences between the groups. 
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It is difficult to separate attitudes towards mathematics from attitudes 
towards the mathematics environment. We cannot conclude that IPI caused 
student enthusiasm. It may have been skillful teachers who produced this 
result and they may have done so using any innovative program. In future 
evaluation activities it will be useful to interview students so that the ques- 
tions can be explored. 


Comparative Study of Teacher Attitudes 


In order to tap the general feelings that teachers in the IPI and Control 
schools have toward a number of Educational topics, an attitude instrument 
was constructed using the semantic differential format. Two kinds of topics 
were covered. The first set of topics: Innovation, Mathematics Education, and 
Individualized Instruction, were chosen because of their direct relevant to 
the project. The second set: Students, Teachers, Parents, and School System 
were included in an effort to obtain some measure of the general level of 
morale among the teachers. 


The teachers in both groups were asked to rate the topics on the 29 ad- 


jective scales shown below. The instrument was administered in October and 
May. 


Exciting—Dull Systematic—Chaotic 
Temporary—Lasting Extravagant—Necessary 
Authoritarian—Democratic Worthwhile—Futile 
Society oriented—Individual oriented Ineffective—Effective 
Traditional—Modern Reflective—Impulsive 
Difficult—Easy Isolated—Integrative 
Practical—Theoretical Stationary—Moving 
Enjoyable—Boring Peripheral—Basic 
Important— Useless Inexpensive—Expensive 
Concrete—Abstract Frustrating—Satisfying 
Good—Bad Positive—Negative 
Weak—Strong Inadequate—Adequate 
Precise—Vague Not time consuming—Time consuming 
Divergent—Convergent Active—Passive 


Two way analyses of variance were carried out on the judgements of each 
concept on each scale. The independent variables used were IPI versus Con- 
trol group and October versus May testing. In all, 203 such analyses were 
carried out. Since there may be some very high correlations among scales, 
it is very likely that many of the results that are judged to be significant 
could have occurred by chance (even if the scales were independent, one would 
expect 5% of them to be significant.) Nevertheless, for the sake of simplicity 
of presentation and interpretation, the two way analyses were carried out. 
Most of the teachers responded anonymously, so that it was not possible to 
analyse the results properly, that is by taking into consideration the correla- 
tion between pre and post tests. 


In considering the results, it is useful to keep in mind the rationale for 
carrying out the test. If participation in the IPI program (or factors concurrent 
with it such as Hawthorne effect) produced changes in teachers’ attitudes 
that were different from changes that occurred in the Control group then a 
significant interaction should result. If there were a general change in attitude 
for both groups, then a pre-post test (Time) effect would be significant. If 
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the groups differed in attitude prior to introduction to the program, and this 
difference persisted throughout the program, then a significant Program effect 
would be noted. 

In almost all cases, it was clear that even though one group rated “In- 
novation” for example, as being duller than the other group rated it, the 
average values for both groups fell on the exciting side of the scale. Thus 
such a result cannot be interpreted as one group’s thinking that Innovation 
is dull and the other thinking that it is exciting, rather it is an indication that 
one group sees innovation as being more exciting than the other. 


The results showed that only two interactions occurred. This seems to 
indicate that any differences between the groups may have existed prior to 
the first testing occasion. 

Part of the result that the teachers’ attitudes were different prior to the 
first testing occasion may have arisen from the intensive training program 
that was conducted. At a week-long course in IPI methodology that was held 
in Baff in August 1969 much enthusiasm was generated among the teachers 
for the program. The attitude scale was administered in late September and 
early October. 

A second confounding factor was the degree of attention that was paid by 
the Control group to the scale. The Control group received no benefit from 
their participation in the program. In general the teacher attitude scales were 
administered after the Control group had been subjected to a batch of other 
tests in their classrooms and while the cooperation was good, one could not 
help but feel that the attitude scale was seen as an unnecessary imposition 
on the teachers’ time. No indication of any attitude toward the questionnaire 
was received from the IPI group. 


If one looks at the concepts individually, a picture of the teacher’s attitudes 
begins to form. For the concept Individualization, the IPI teachers tended to 
See it as more exciting, lasting, democratic, individual oriented, modern, 
practical, enjoyable, important, good, strong, precise, integrative, moving, 
satisfying, worthwhile, effective, reflective, positive, adequate and active than 
the Control group. Again the responses indicate that the IPI teachers are 
generally enthusiastic about the program. It is interesting to note there were no 
differences on the time scale. This is one of the situations where both groups 
saw individualization as very time consuming. Similarly on the difficult-easy 
scale, both groups placed Individualization at the difficult end. 


The Parents’ concept showed significant differences on 17 scales, with 
the IPI teachers seeing parents as more exciting, lasting, democratic, easy, 
practical, theoretical, enjoyable, important, good, integrative, inexpensive, 
satisfying, worthwhile, effective, positive, adequate, not time consuming, 
and active than the Control group. The responses to this concept illustrate 
one of the problems with this technique. Often seemingly inappropriate 
scales such as temporary-lasting show differences among groups. With 
interviews, the reasons for the responses can be explored; with question- 
naires, the reasons are left to the imagination of the interpreter. Two 
kinds of interaction with the parents were different for the two groups. 
Parent interviews were used in place of report cards for the IPI group, 
and parent volunteers were used to aid the teachers in the classroom. 
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For some of the scales it may have been this increased contact with 
parents that produced the results. In particular the responses to the scales 
such as enjoyable, satisfying and worthwhile might reflect this. On 
scales such as lasting and inexpensive, the IPI group may be referring 
to the effect that parents were having on the IPI program as a result 
of their volunteer activites. 


Sixteen scales were significant for the concept Students. The IPI 
teachers rated this concept as more exciting, lasting, democratic, individual 
oriented, modern, practical, enjoyable, important, strong, precise, moving, 
satifying, systematic, worthwhile, positive and adequate. Again, it is dif- 
ficult to separate generalized reactions to students from reactions to 
students within the context of IPI. It seems safest to suggest that all of 
the teachers seem to have a high regard for students with IPI teachers 
giving slightly higher ratings on some dimensions. This may have re- 
sulted from more contacts with students on a one-to-one basis since the 
IPI system requires teacher-pupil conferences. Whether or not the actual 
time spent with individual students is greater in the IPI system has yet 
to be established. 


IPI teachers rated Teaching as more exciting, lasting, democratic, in- 
dividual oriented, modern, enjoyable, important, integrative, moving, ef- 
fective, positive, adequate and active than did their Control counter- 
parts. Both groups saw teaching as being practical, good, strong, complex, 
expensive, satisfying, systematic, necessary, worthwhile, and time con- 
suming. It would seem that the teachers in both groups must be described 
as dedicated to their vocation. Large differences existed on two scales: 
democratic and individual oriented. These scales may reflect attitudes 
that are program specific. 

Mathematics Education produced only nine significant scales. IPI 
teachers rated the concept as more exciting, democratic, individual 
oriented, integrative, moving, expensive, effective, and active. Many of 
these scales seem fairly closely related to the program. The attitudes 
toward Mathematics Education in a broad sense seem fairly similar. 


The School System, the concept furthest from the IPI program, showed 
significance on six scales. The IPI teachers rated it more democratic, 
important, necessary, worthwhile, reflective and adequate. Perhaps, six 
scales represent a sort of chance level. None of these scales seems 
particularly important. In general, teachers’ reactions to the School Sys- 
tem seem to vary from neutral to fairly positive. One would not expect 
many differences here as the School System is quite remote from in- 
dividual teachers. 

Given the conditions under which the instrument was administered; 
that is after the program had been in operation for a month, one can 
see that it would be difficult to show the significant interactions sug- 
gested earlier. It does appear that the enthusiasm toward the program 
has not flagged over the year between administrations. In looking in 
general terms over the concepts and scales it seems fair to conclude 
that the IPI teachers have responded enthusiastically to the research 
that has been conducted in their schools. Much of this effect is likely 
due to either the novelty of the situation, or the special treatment given 
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to the schools, however, collection of similar data in subsequent years 
when the novelty effect has gone will indicate long term differences that 
exist in attitudes. 


Teacher Interviews 

Conners (1971) interviewed the 33 teachers who had worked with IPI 
for eight months in an effort to determine their opinions about the pro- 
gram. Six question areas were explored. 


Question One: What perceptions do teachers have of IPI mathematics 
as an instructional package? 

The study revealed that most teachers were extremely satisfied with 
IPI mathematics as an instructional package. The objectives of the pro- 
gram, the materials used, as well as the structure and flexibility of the 
program were considered as good, if not superior to most programs. 
However, more definite advantage were claimed for IPI over most other 
programs. In the opinion of the majority of teachers, IPI mathematics 
provides better for the “above average” and “average” pupils than most 
mathematics programs because it does not inhibit the pupils’ progress. 
IPI also, through its variety of instructional approaches, appears to pro- 
vide well for the different learning styles of pupils and allows pupils 
to work at their own pace. It must also be noted that after contact with 
IPI, all teachers in this study indicated their desire to individualize in- 
struction in most other subject areas. 


While IPI appears to have many “strengths,” there appear to be some 
“weaknesses” in the program. The data suggest that IPI does not free 
the teacher from teaching the routine, basic skills of mathematics. It 
appears that efforts on the part of the teacher have now been transferred 
from a large group situation to an individual basis. The data also suggest 
that IPI, because of the structure and the pressures of the system, does 
not provide “well” for the student who wishes to pursue some special 
interests in mathematics. 


Question Two: What perceptions do teachers have of the role of the 
teacher in the IPI system? 


The data suggested that in the IPI system the teacher’s role is changed 
from the traditional concept. The teacher lectures far less, works harder 
and has more demands made upon him in knowing the subject matter 
and curriculum. However, it appears that there is greater satisfaction work- 
ing in an IPI classroom when compared to a conventional classroom be- 
cause the individual contact with students allows the teacher more op- 
portunity to assist the individual pupil than was previously possible in a 
conventional classroom. This satisfaction is enhanced because of the im- 
mediate feedback concerning the student’s progress. The data also in- 
dicated that teachers in the IPI situation find their role to be more chal- 
lenging, modern and professional than in a conventional classroom. It 
appears that IPI presents an opportunity for the teacher to work ef- 
fectively with each individual in the classroom. The teacher is given an 
opportunity to become more “professional” as she becomes a “diagnos- 
tician” of learning, a decision maker and a guide for the pupil rather 
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than a “fund of knowledge.” It appears therefore, that IPI creates 
greater opportunities for the teacher to use all her science and art as a 
teacher, in order to assist the individual pupil. 


The data also suggest that contrary to some opinions, the IPI teachers 
do not find working in the IPI situation to be a “dehumanizing” experience 
for themselves or the pupils. In fact, it is suggested that IPI assists 
teaching and learning to become a more “humanizing” experience for 
both teachers and pupils because the teachers come to know and under- 
stand the students better as individuals. 


Question Three: What perceptions do teachers have of pupil reactions 
to the IPI program? 


Analysis of the teachers’ perceptions indicated that most pupils react 
very favourably to IPI mathematics and prefer working in the IPI system 
to working in a conventional program. It appears that when pupils have 
been exposed to an individualized program of studies, then the majority 
do not wish to return to a “whole class” approach. It also appears that 
involvement in the IPI system fosters pupil initiative, self-confidence and 
responsibility, and that behavior problems decrease. Pupil motivation is 
extremely high in IPI, and in the opinions of teachers, more mathematics 
is covered than in a conventional program. 


Question Four: What perceptions do teachers have of the role of the aide 
in the IPI program? 

The study revealed that IPI could not operate effectively without the 
assistance of teacher aides. It appears that the aides are essential for 
marking and other clerical duties so that the teacher can devote her time 
to helping individual pupils. The data also indicate that the aides have 
become an accepted and integral part of the schools involved in the IPI 
project. 


Question Five: What perceptions do teachers have of the ways in which 
IPI has influenced the organization, administration and functioning of 
the school? 


The results indicated that teachers appreciate the opportunity given 
them to individualize instruction, that they do not wish to return to the 
“traditional” methods of instruction and that IPI has a positive influence 
upon their educational philosophies. It is also suggested that IPI need not 
interfere with the general administration of the school and that it can 
influence the behavior of the administrators by bringing them into the 
classroom more than normally. Administrators, because of this contact, 
are in a position to “get to know the pupils better.” 


Question Six: What perceptions do teachers have of the manner in which 
IPI has affected the school system and the parental community? 

The study suggested several extremely advantageous aspects of IPI are 
related to the parental community. It appears that IPI can assist in the 
improvement of communication with the parental community because the 
use of volunteer (parent) aides can bridge the gap between school and 
community, and because pupil enthusiasm for the program is transmitted 
to the parents. Secondly, involvement of parent aides can engender more 
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parental support from the community. Thirdly, the detailed IPI records 
give teachers a more concrete basis to discuss a pupil’s progres with his 
parents. 

In addition to the major questions, four subquestions were explored. 


Sub-Question One: Do teachers in schools situated in an urban, higher 
socio-economic area; an urban, lower socio-economic area; and a rural 
area, have different perceptions of the IPI program in mathematics? 


The study revealed that there were no major differences between the 
perceptions of the teachers in the three schools, (one rural, one in an 
urban, higher socio-economic area and one in an urban, lower socio- 
economic area). However, the data do reveal some minor differences. 
They suggest that pupil peer rivalry is more likely to increase in an 
urban school, and especially in one situated in a higher socio-economic 
area. Teachers from the rural school were also more prone than teachers 
from the two urban schools to consider that their role had become more 
professional, while teachers in the urban schools considered their role 
as a teacher had become more modern. The only school that perceived 
IPI provided well for the ‘below average” pupil was the school in the 
urban, lower socio-economic area. 


Sub-Question Two: Do teachers with different teacher training back- 
grounds have varying perceptions of the IPI program? 


The results indicated that the professional training a teacher has 
received does not appear to influence her performance in IPI or her 
perceptions of the majority of the aspects of the program. It is, how- 
ever, suggested that the more highly trained a teacher is, the more 
conscious she becomes of the need for adequate conferences and planning 
sessions, and the more training a teacher has, the less likely she is to 
expect assistance from the teacher aides. 


Sub-Question Three: Do teachers with varying years of teaching expe- 
rience have different perceptions of the IPI program? 


The study revealed that the less experienced teachers were more 
likely to request and need additional inservice conferences, planning and 
training sessions. The less experienced teachers considered that their 
role had become more modern since the introduction of IPI, while the 
more experienced teachers perceived that the assistance of aides had 
helped to positively change their attitude toward teaching. 


Sub-Question Four: Do teachers’ perceptions of the IPI program vary 
according to the grade or class taught? 

The study revealed that pupil attitudes and behavior were more 
likely to change in the upper elementary grades than the primary grades 
after contact with IPI. It is also suggested that teachers of the upper 
elementary grades are not as prone as teachers of the primary grades 
to involve teacher aides in actual “professional” work, and that they 
are more likely to favour individualization in “all” subjects. The data 
also revealed that IPI provides well for the “below average” student 
in the upper elementary grades, while it appears to provide “unsatis- 
factorily” for the “below average” student in the primary grades. 
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In summary, Conners’ study (1971) showed that the teachers were 
generally pleased with the success of the application of IPI, but had a 
number of important suggestions for future development. 


Parental Opinions of IPI 


As a final component in the evaluation, Hoke (1971) interviewed a 
random sample of 35 parents who had children in the IPI program. 
Three kinds of opinions were solicited: opinions of the program as ad- 
ministered in the school, effect of the program on children, and opinions 
of personal communication and administration details connected with 
the program. 


A’ number of questions were asked of the parents concerning their 
thoughts about the IPI program itself. In response to a question asking 
about the desirable features of the program, the five most common 
responses were: 


. Children can work at their own speed. 

. Teacher aides were hired. 

. There were benefits using parent volunteers. 

. There were benefits in parent teacher conferences. 

. Instruction was individualized which developed the child’s own schol- 
astic and personality strengths. 
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When asked for the least desirable features of the program, the five 
most common responses were: 


1. The slow unaggresive or lazy child was not pushed and given enough 
teacher supervision. 

2. Parents, unable to volunteer were not involved and were frequently 
not informed about the arithmetic concepts completed by their children. 

3. Children did not take arithmetic homework. 

4. The desk work of the teacher prevented her from circulating around 
the class to teach, encourage, or supervise. 

5. The IPI student profile sheet had little meaning for comparative 
purposes. 


In response to questions concerning specific facts of the program, 
most parents were in favor of the children working at their own speed, 
but only about half of the parents were pleased with the lack of home- 
work in IPI. 

When responding to questions concerning the effect that the program 
was having on the children, about half of the parents thought that their 
child was achieving more than in the previous year, whereas only ten 
percent thought that the child was achieving less. Eighty percent of 
the parents were satisfied with the achievement. In response to ques- 
tions concerning the effects of IPI on the children’s future progress, 
some parents expressed concern with the lack of continuity between 
elementary and junior high school, however most of the parents indicated 
that experience with IPI would have a beneficial effect on the child’s 
attitudes toward school in future years. 

The final set of questions referred to the opinions of the personnel, 
communication and administrative variables connected with IPI. Most of 
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the parents were in favor of hiring teacher aides. They were also in favor 
of the use of parent volunteers in the classroom, although none of the 
parents interviewed was a volunteer. The child’s progress was reported 
to the parents by means of an interview. Most parents liked these reg- 
ularly scheduled conferences but a few criticisms were voiced: more 
interviews were needed; teachers can frighten parents if the parent does 
not have much self confidence; because the child is not at the interview, 
he cannot benefit from the feedback directly. 


In response to a question asking whether or not the parents saw IPI 
as being worth the extra cost that was required, over 80 percent of the 
parents answered yes. Over 50 percent of the parents said that they would 
be in favor of an increase in taxes for improving educational standards 
using programs like IPI. 


IPI arithmetic was valued for the effect it had of creating enthusiasm 
and motivating their children so that school became more interesting 
or likeable. Because of this, parents felt IPI was a superior instructional 
method, and was an improvement over the textbook approach. Several 
people felt the IPI method made the child’s mind more alert and re- 
sulted in the learner being able to think more clearly. The concept of 
mastering materials was valued because parents felt that slow, medium, 
and fast working children would become more skilled in arithmetic. It 
was felt most children were benefitting from individualization of instruc- 
tion; none were being held back or being forced to catch up with the 
class. 


In general, there were a number of conditions which made the IPI 
project acceptable to the respondents. In the parents’ estimation, the 
three experimental plants were excellent schools; parental communica- 
tions with the school had been adequate during the first year of the 
study and also during the preceding year; the parents expressed respect 
for the qualifications, competency, and personalities of the school person- 
nel; they were pleased with the quality of instruction in all subjects; 
and the parents felt that the various methods of reporting child progress 
complemented one another. 


There were indications from parents that the IPI arithmetic program 
should have some restrictions placed on its implementation. Every parent 
interviewed, who had a first year (grade one) student working with the 


IPI materials, questioned the value of the instructional method for these 
students. 


Summary and Discussion 


In attempting to tie together the results of the evaluation, one becomes 
concerned that the particular schools chosen for the study may not be 
typical of the elementary schools in Alberta. To some extent this must 
be true. The IPI schools were chosen because of their willingness to 
innovate. The bases for nominating the Control schools were: the social 
class of the community served, size of staff, number of students, and 
similarity of physical facilities. It became apparent that the Control 


schools also possessed many of the same forward looking philosophies 
as the IPI schools. 
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In discussing the results it must be remembered that the participating 
teachers became very enthusiastic about the program and it is difficult 
to separate the effects of the program from the effects of the teacher 
enthusiasm. The results may generalize to other situations where IPI is 
used. We report what can happen not what will happen. 


In capsule form, six conclusions can be highlighted from the research 
evidence. 


1. IPI students did not achieve more than the Control students. In 
fact, where differences did occur, they favored the Control students. The 
achievement measures used, CTBS Arithmetic Skills and Problem Solving 
Subtests, are generally accepted as being among the most useful of 
the standardized tests of arithmetic achievement. Since they were de- 
signed to measure fairly traditional objectives, they were considered as 
appropriate in the present study. 


2. The IPI students had a more positive attitude towards arithmetic 
than the Control students. The main difference between the two programs 
(other than the teacher variable) is that the children proceed at their 
own speed in the IPI program. As a result, there may be fewer frustra- 
tions. The sequence of material is about the same, in the two programs, 
so that time and the ability to work to a certain extent under conditions 
of their own making may be the important variables for student satis- 
faction. 


3. The IPI teachers were more positively disposed towards innovation 
and individualization than their colleagues in the Control group. It seems 
unlikely that IPI per se had much to do with this finding. It is more 
likely that two situations acting in opposite directions combined to pro- 
duce the result. Participation in an innovation—particularly one as highly 
structured as IPI—can easily produce a positive attitude toward the 
project. On the other hand, being asked to act in a Control group 
with no short term payoff can easily have the reverse effect on the 
Control teachers. These two factors in combination may account for the 
difference between the two groups. In any event, as a result of partic- 
ipating in the project, the teachers seem to have developed an openness 
to innovation. This openness coupled with the experience with a fairly 
successful program suggests that a pool of teachers now exists with 
whom curriculum development projects might be undertaken. 


4. The IPI classroom allowed for more extended student interaction 
with teachers than did the Control schools. Often, one of the charges 
made against individualized programs is that they overlook the important 
social component of education. The results of this evaluation suggest that 
the reverse might be true. Extended teacher-student interactions are those 
interactions in which the student is allowed to talk to the teacher for 
sustained periods. This being the case, the results suggest that IPI stu- 
dents have longer conversations on an individual basis with their teachers 
than Control students do. A second interesting result of the interaction 
analysis was that IPI teachers used fewer controlling and criticising state- 
ments than their Control counterparts. 
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5. Parents of children in the IPI program were favorably impressed 
with the program and more than half of the parents would favor an in- 
crease in taxes to support the program. It is difficult to say if the 
parents’ behavior would be consistent with their statements, neverthe- 
less, their acceptance for all facets of the program was impressive. Many 
parents noted that changes had occurred in their children’s attitudes to- 
wards arithmetic, and seemed to place a good deal of importance on this 
observation. 


6. The parents freely gave their time to help in the many clerical 
chores that form part of the program. It is very difficult to say how the 
cooperation would be over an extended period of time. Clearly, the par- 
ents saw the program as experimental. It may be that as a program 
such as IPI became institutionalized, the parents would expect the 
boards to take over the responsibilities for clerical chores. 


In discussing the results and attempting to reach some overall evalua- 
tion of the project, a number of factors must be weighed against each 
other, and to some extent each reader must pass judgment according 
to his own value system. The IPI program did not produce higher achieve- 
ment on measures of educational objectives that are generally valued by 
society. The cost of the IPI program is greater than that of the standard 
elementary school arithmetic program. These two factors would suggest 
that the IPI program does not produce compensating benefits for higher 
costs. But the IPI program (and the teachers) do bring about more positive 
attitudes towards mathematics. How does this benefit stack up to the 
cost? Many parents felt that the results were worth more than the 
cost; however, one of the truths of educational research is that enthu- 
Slasm is an unstable commodity. Will the same results persist if the pro- 
gram is carried-on or instituted on a wider scale? Will parents continue 
to volunteer their services as the program becomes common place? Will 
achievement in the IPI schools actually fall behind that of the Control 
group as teacher enthusiasm is focused on other matters? Will achieve- 
ment in the IPI schools become superior as teachers and students become 
more familiar with individualization? These are some of the questions 
that must be answered before decisions for adoption are taken. 
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Humanization of Learning: 
A Mission in Embryo 


The Humanization of Learning Mission has its origin in those programs 
of study which emphasized the broad area of individual development and 
which have now become directed more specifically to the personalization 
of teaching and learning. A survey of various individualization programs 
in schools revealed that the learner was largely neglected in prominent 
curriculum development programs. In an effort to rectify this condition, 
the Mission is directed toward developing program alternatives which 
would accept as critical priorities for schooling the development of self- 
awareness, empathic understanding, and the enhancement of social respon- 
sibility. This article identifies and highlights some of the critical decision 
points that have had a significant impact on the development of the 
Mission. Particular attention is given to the demands of researchers, 
practitioners,and those who support such projects during the design stages. 


The purpose of this paper is to examine the interconnections between 
the processes of research and development in education and the institu- 
tion and evolution of HRRC’s Humanization of Learning Mission. How 
one approaches this task will reflect the style and biases of the writer 
as he identifies the central enigma which permeates all development 
efforts in education. This central enigma is reflected in the selection and 
application of the available knowledge base and the forging of prac- 
tical decisions in field developments. Two possibilities present them- 
selves: 

(1) One could attempt a systematic and logical explication of those 
procedures that have been identified as characterizing research and 
development in education and apply these procedures to the actual events 
that have given rise to this Mission. In the course of such application 
one could then appraise the appropriateness and usefulness of such pro- 
cedures as they apply to a particular endeavour on the one hand while 
ascertaining possible oversights in the tactical management of the 
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Mission’s evolution on the other. This would be the approach of the 
scholar-researcher as he attempts to articulate any area of ambiguity. 


(2) Another approach would be to proceed more pragmatically and 
describe the evolutionary process “as it really was and is,” at least, as 
one who has been close to this development perceives these evolutionary 
events. 


For reasons that will hopefully become apparent, the latter approach 
was selected and a serious attempt has been made to highlight those 
encounters and confrontations, those critical points of decision and 
action which, in retrospect, can be seen as having impinged significantly 
upon the growth and development of the Humanization Mission. Finally, 
practical implications for the developer will be drawn. 


Four questions provide a focus for the discussion: 


(1) How did the Humanization Mission become launched? What events 
led to its founding? Perhaps more particularly, what were the grounds 
upon which confident judgment was attained with respect to its relevance 
and promise to education in Alberta? 


(2) What were the significant encounters and critical decision points 
through which the evolution of the Mission proceeded and at which 
instances major developmental decisions were made? 


(3) What congruities or incongruities were encountered as adjudication 
of the Mission’s rationale and development was achieved through expo- 
sures to significant publics who are concerned about education’s future? 


(4) What are the sources and grounds for sustaining confidence in what 
is essentially a system of beliefs that is calculated to give shape to a 
more viable institutional response to the contemporary urgencies of 
man? 


The Birth of a Mission 


In keeping with its mandate, the Alberta Human Resources Research 
Council embarked upon a series of studies emphasizing the broad area 
of “individual development.’ Among these studies, one focused upon an 
empirical examination of the recent attempts to individualize instruction; 
another subjected a particular instructional system, Individually Pre- 
scribed Instruction, to systematic implementation and evaluation on the 
Alberta scene; and others were theoretical inquiries directed at the 
nature of individuality. With respect to the Baseline Study on Individ- 
ualization (of instruction), it became readily apparent after a matter of 
months of investigation that a growing number of schools, especially 
in the United States, were moving aggressively into various approaches 
for individualizing their instructional programs (Edling, 1970). There is 
a considerable amount of empirical justification for the schools’ attempts 
to individualize instruction, in that for some decades now the practising 
educator has struggled with, if not resolved, the problem of individual 
differences in the classroom. One feature, however, loomed large in this 
survey and that was the primarily instrumental character of these individ- 
ualization efforts. Projects and programs surveyed were largely attempts 
at devising more effective and more powerful means by which learners 
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can be helped to approximate the traditional objectives of the school 
which continue to emphasize intellectual mastery of subject matter con- 
tent and the acquisition of selected skills in communication and computa- 
tion. The purposes and processes involved in evaluating the outcomes 
of such efforts continued to focus upon judgmental emphases rather 
than diagnostic concerns, which would have been more consistent with 
the primary purposes of individualization. 


When these data and their implications were examined and thrust 
against the emerging needs of the prospective future, it became clearly 
apparent that important dimensions, particularly those involving the 
learner, remained largely neglected in the prominent curriculum develop- 
ment programs. How does the learner feel about himself as a person, what 
fears and struggles is he enduring, how does he attempt to work out 
some acceptable approximation of the school’s and his own expectations 
—these and other such questions remain, at best, at the periphery of 
the individualization movement. Growing self-awareness and the judg- 
ments which the learner makes of his own competence and adequacy 
are not accepted by school pratitioners as a point of major concern 
and responsibility. The learner is still compelled to persist in his alone- 
ness in achieving some sense of functional adequacy. With rare excep- 
tion, the major projects in new curriculum development and the design 
of instructional systems continue to evolve around new organizations of 
subject matter content. The Humanization Mission is based upon the 
recognition that additional grounds for achieving new curriculum designs 
must be introduced and these have to do with societal as well as individ- 
ual concerns (Macdonald, J. B., 1971). 


Serious doubts were therefore generated by the early studies on in- 
dividualization. A critical one is the expectation that a ceiling of learner 
achievement is likely to be encountered when the efforts of schools do 
not take into account sources of inner motivation and commitment within 
the learner. Any curriculum design based on grounds other than the 
personal concerns and propensities of the learner faces eventually the 
problem of motivation and must contend with the necessity either to 
compel the learner into compliance or to elicit from him an interest in 
the learning task. Hence, the learner must be provided opportunities for 
enlarged participation in the selection and conduct of his learning engage- 
ments. In keeping with this premise, therefore, the Humanization Mission 
provides specifically for the ethical or moral commitment involved in the 
learner’s “right to choose” the kind of person that it is within him 
to approximate. 


The Humanization Mission, therefore, is, at this stage, essentially an 
effort to articulate and establish with defensible evidence and argu- 
mentation the critical importance of the following questions which should 
guide the shaping of schools’ efforts to help the young: 


Who am I? What kind of person do I want to become? 

What do I want, need, seek? What is really important to me, to my life? 

What are my unique strengths and weaknesses? How can I best manage 
them to achieve my goals? 
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How do I reach my goals? What opportunities are open to me? What 
obstacles do I face? 

What courses of action do I choose? How do I pursue them with con- 
fidence and hope? 

How do I relate to other people? When and how do I need them? When 
and how do they need me? 

How can I gain increasing respect for myself as a person, a hopeful view 
of life and its meaning, and a positive feeling for others? (Inform, 1971) 


To identify the critical shortcomings of current schooling is one thing; 
to enlarge upon, substantiate and effect plans and designs that promise 
viable alternatives represent something else again. It is in this latter area 
of tasks that the Humanization Mission is now critically engaged. 


Period of Courtship 


In the early stages of the birth of the Humanization Mission there 
occurred a period of what may be called intellectual courtship, covering 
a time when exciting ideas, promising visions, and enticing prospects 
for change became the object of considerable talk, both formal and 
informal, with like-minded professionals, researchers, and practitioners in 
the field. During this phase of deliberation a good deal of sympathetic 
encouragement was solicited from many sources and individuals. It was 
a time of working papers, akin to that of any act of creation, where 
excitement built upon excitement through a successive series of 
spawned ideas that were gradually committed to paper in some tangible 
form. Finally, a working paper in draft form emerged from this heady 
activity, coming as it did without too much concern (nor time) for rigor, 
reflective attention and responsible development. It was indeed a time 
of immense productivity with gay abandon. Then the “infant” was here 
in the form of what had come to be known as the first rationale state- 
ment for the Humanization of Learning Mission. 


This statement encompassed three areas of concern: 


(1) the examination of the directions in which new curriculum designs 
are moving and the bases upon which they are founded (they continue 
the traditional emphasis upon the development of cognitive functions in 
the learner and employ as the principal organizing theme the nature or 
structure of knowledge). These were assessed as inadequate in the light 


of the range of human urgencies and social concerns facing the individ- 
ual today. 


(2) a renewal of scholarly interest in the “phenomenological” study 
of human behavior and learning; researchers, for instance, are begin- 
ning to pay systematic attention to such notions as self-concept and the 
sense of “caring” as factors influencing the learning achievement of 
youngsters. 

(3) a tentative description of select human attributes which are pro- 
posed as central to the eventual improvement of the quality of life for 
all. Of particular interest to the Humanization Mission was the impor- 
tance of self-awareness, empathy, and social responsibility as instru- 
mental values. Even at this stage of articulation, there emerged a growing 
awareness of the implicit, if not explicit, presence of value assumptions 
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within this statement, the lack of clarification regarding a conception of 
the nature of man, and the tendency to sympathize with a “humanistic” 
conception of learning and human development. 


At this stage, only cursory attention was directed at the possibilities 
resident in the various social and behavioral disciplines, particularly 
what is known with reasonable confidence about the phenomena under 
examination. The assumption was that these disciplines had a consid- 
erable amount to contribute to the advancement of such a mission but 
the nature of their contribution was yet to be ascertained. Hence, the 
decision was made to subject this embryonic rationale to the critical 
appraisal of the community of scholars in the Social Sciences, Philosophy 
and Education. 


Moment of “Truth” 


In June of 1970 an invitational seminar was arranged at which this 
first statement of “beliefs” was subjected to the rigorous scrutiny and 
assessment by those “who know’ in the basic social and behavioral dis- 
ciplines. The purpose of the seminar was essentially to assess the defen- 
sibility, both theoretical and empirical, of the Mission thrust. More specifi- 
cally, participants were to probe areas of critical weakness and to identify 
gaps in the warrantability of conceptual structures, propositions and as- 
sumptions across the wide range of relevant phenomena. They were also 
asked to assess the developmental prospects of the Mission and to assist in 
proposing criteria for judging its pedagogical and economic possibilities. 
Finally, the participants were encouraged to give expression to their own 
personal visions of the possible and in this way help to chart some pro- 
mising developmental directions. Prior to the seminar itself, selected re- 
source specialists were asked to prepare a short statement in which they 
gave expression to their own criticisms and assessments of the Mission 
plan. 


This series of confrontations, both written and oral, was to reveal: 
(1) the existence of a considerable repertoire of useful and relevant 
understandings and insights that would help substantially in amplifying 
and clarifying the particular concepts and propositions subsumed by the 
Mission statement, and (2) dramatic evidence of the shortcomings within 
this repertoire in helping to chart reliable directions, choices and pro- 
grams of action in the practical field of education. The latter merely 
confirms what, since that time, has been identified as the inappropriate 
use of research in pursuit of warrantable conclusions and generalizations 
to inform practical decisions and actions in specific human contexts 
(Schwab, 1969; Cronbach and Suppes, 1969). 

A summary of outcomes and effects of this series of encounters 
with the scholar-researcher has high relevance at the point of link- 
ing whatever is known to any developmental task or program in 
education. First, as befitting the scholar-researcher, the resource specialists 
were particularly astute and incisive in their critical analyses of the 
Mission statement. They were as a group, however, reluctant or unable 
to suggest productive ways in which problems could be solved—problems 
involving conceptual clarification, the warrantability or usefulness of 
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particular assumptions and propositions, and the strategies of moving such 
a design into more operational phases. Again, one appreciates the dif- 
ficulty of such an assignment in view of the inappropriateness of the 
methods and modes of theory construction and empirical investigation 
in the basic disciplines to the task of forging defensible decisions in 
practical field settings. 


Nevertheless, a number of critical assists were obtained. The Humani- 
zation Mission, at the outset, was challenged on the grounds that its value 
premises were not clearly indicated. What values or value systems guided 
the thinking of the project staff; what assumptions were being made in 
setting priorities concerning human attributes of rationality, empiricality 
and the like; and what further normative and descriptive assumptions 
were being made in the prospective selection of intervention strategies 
through instructional procedures? On this question of value assumptions 
permeating the Humanization Mission, two alternatives presented them- 
selves. One suggested a treatment that moved to ultimate purposes of 
life and the values of truth, goodness, justice and freedom. Or one could 
propose the introduction of a concept such as “survival,” not as a norma- 
tive designation but as an empirical construction, much in the way that 
Scriven (1966) argues its treatment. The urge to survive is reflected in 
the behavior of all men in all contemporary circumstances. 


The Humanization Mission then established the grounds for its selec- 
tion of priorities by focusing upon the emigmas facing current man at 
a time when prospective futures, given present trends, lead predictably 
to his progressive deterioration—biologically, socially and psychologically. 
Given this point of departure, the argument then urges that schools must 
focus upon human problems and crises which impinge upon the person 
of the learner as he struggles to maintain some degree of functionality 
in handling the stresses and strains of living in some adequate way. It 
is not that each person will not have to demonstrate the highest level of 
intellectual competence in the course of his struggles. The Mission merely 
asserts that, in addition to such competence, each learner must be as- 
sisted, with equal promise, in cultivating high levels of compassion for 
others and a commitment to the enhancement of well-being of all in a 
mutually interdependent world. Hence, the focus is upon self-awareness, 
empathic understanding and the assumption of social responsibility as 
critical priorities for schooling in this latter half of the twentieth century. 


A second critical concern was a repeated query as to the conception 
of man held or implied within the Mission rationale. Here too, the task 
reflects itself in an apparent necessity to consider two such conceptions, 
the behavioral and the phenomenological (Hitt, 1971). Still, while the 
stipulated emphases in behavioral outcomes tend to represent a sym- 
pathetic relationship to the phenomenological approach to the study of 
man, it would be premature and, in all likelihood, imprudent to set forth 
such a definitive choice and attempt to remain consistent in its applica- 
tions. Earlier debate about the nature of man led to such judgments as 
man is rational; man is irrational. Man is good; man is evil. Man is 
shaped by culture or by his inherent nature; man shapes himself by the 
exercise of “free will”. And so on. The tentative “resolution” of this 
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dilemma is reflected in the acknowledgement that man is none of these 
and all of these at the same time. For the moment, a conception that 
man is malleable can be reasonably grounded in the recent cultural 
anthropological studies of human nature and its evolution. 

A third issue involved the selection of a particular “source” for a 
curriculum design implicitly indicated by the present Humaniza- 
tion statement. Is the prospective curriculum design premised upon the 
central place of knowledge or the disciplines (the current point of departure 
in most modern curriculum developments on the North American con- 
tinent), the demands of society or the needs and problems of the learner? 
Once more, any curriculum design in fulfillment of the Humanization 
idea will of necessity have to contend with all three such sources of cur- 
riculum construction. It can be said with some confidence, however, that 
serious weakness has been acknowledged in the exclusive use of the 
structure of the disciplines as an organizing principle, particularly as the 
needs, aspirations and propensities of the learner as an evolving human 
being are not taken into significant account. Indeed, it is assumed that 
enquiry into problems of the discipline will eventuate in the exciting en- 
gagement of the learner as an enquirer much the same way that scholars 
and research scientists are fascinated and intrigued by the anomalies of 
their own subject matter. Even Bruner (1971) has recently acknowledged 
the questionable character of this premise. 


The significance of this encounter with the disciplines for the would- 
be developer is a critical one. Admittedly, it is assumed that any develop- 
mental effort, if it has any prospects for successful intervention, will have 
to draw upon what is confidently known in that body of relevant and 
reliable knowledge. The difficulty, of course, occurs in the attempt to 
select and apply such knowledge to advance the purposes of development. 
This difficulty originates from the fact that the different social and be- 
havioral disciplines have their own systems for charting the study of 
human phenomena. Schwab (1960; 1964; 1969) has begun to examine this 
enigma in a systematic appraisal of the different forms of enquiry and 
the demands for practical decision-making. It should be apparent to all 
educational researchers and developers that different disciplines take dif- 
ferent “slices” of the human phenomena which are subjected to scrutiny 
and study. Not only do they select their data for systematic examination, 
they also tend to order the constituents in different taxonomies or clas- 
sification systems. As Schwab points out, each one selects some distin- 
guishable set of phenomena while leaving others ignored. The chal- 
lenge to the developer, however, is to establish viable negotiations with 
the actual flow of real events in particular settings. Such settings present 
him with an enormous array of ascertainable ‘units’ functioning in a 
wholistic configuration of interlacing, interacting and interdependent 
linkages. Hence, he is driven to make whatever pragmatic use is indicated 
of, say, the systems of classification or taxonomic schemes, knowing at 
the same time that such schemes offer him limited power to comprehend 
and manipulate the entire range of relevant events. 

One of the consequences of descriptive classifications is the apparent 
necessity to continue to make such distinctions as “cognitive” and “af- 
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fective” even though serious criticism is directed to such use in a develop- 
mental setting. Still, one can only argue that an enormous amount of 
respectable research and development effort has been predicated upon 
this very distinction of educational objectives in much educational research 
(Bloom et al., 1956; Kratwohl et al., 1964). This difficulty is compounded 
further when recognition is made of the extended dichotomies in the study 
of human behavior throughout the history of psychology when reason 
was juxtaposed against emotion, thought against feeling, and mind against 
body. Either the developer struggles to resolve or reconcile such explicit 
distinctions in the interests of approaching reality with more viable tactics, 
or he lives with such a distinction, distateful though it may be, while 
moving with caution into more specific instrumental designs. The 
danger, however, is that such conceptual structures based upon units of 
observation and description lead also to a pragmatic separation and com- 
partmentalization of thought. Such a prospect is especially troublesome 
to the Humanization Mission, inasmuch as its central necessity is to syn- 
thesize and integrate efforts at schooling in response to social need and 
human urgency. In the meantime, the challenge of forging more over- 
arching structures in the study of human behavior must be returned to 
the theoretician and researcher in the social and behavioral disciplines. 
The developer, on the other hand, is encouraged to pursue, albeit in a 
“messy” way, a kind of responsible eclecticism which involves bringing 
to bear to the point of action anything that is known with confidence in 
whatever relevant discipline. Macdonald (1966) expresses added sympathy 
for the participant in an “interdisciplinary noman’s land” when he sug- 
gests that 


. the only unity is imposed by the organizational demands of uni- 
versities and faculties or schools of Education, or by the carefully planned 
and large-scale educational research which some of us hope will eventually 
be undertaken, as apart from simply being talked about... . If educationists 
wish to hasten the process, they can do a great deal by entering the em- 
pirical world and helping to foster the conditions which make possible this 


limping but inevitable development of education as an academic study 
(p. 237). 


Caught In The Crossfire 


Any developmental effort such as the Humanization Mission has to 
contend with at least three levels of adjudication: researchers in educa- 
tion and the human sciences; practitioners in the schools and in related 
service agencies; and members of Government who must eventually grant 
or deny support. A few pointed examples should serve to illustrate the 
way in which these adjudication processes give rise to persistent, some- 
times non-reconcilable demands. The theme of “survival” was chosen as 
the basic organizing principle around which to establish the relevance of 
a set of human attributes. This was challenged by some academicians as 
representing a serious compromise of the inspiring “dream” of humani- 
zation. It was, in effect, a dilution of something of much greater worth 


and significance and the interjection of a ceiling for man’s aspiration to- 
ward the “good life’. 
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Similarly, the selection of the name of the mission, Humanization of 
Learning, was criticized by school practitioners as implying that present 
schooling experiences are proving to be de-humanizing. Research analysts, 
in turn, condemned this and other comparable phrases as “sloganeering”. 
Such criticisms, while they may have some justification, do not allow for 
a growing trend toward more involvement of non-professional publics, 
including parents and learners, in the designing of future educational 
programs. This is not to be construed as reason for tolerating conceptual 
ambiguity, indefensible generalization and questionable logic of argu- 
mentation. It simply means that the academician who engages himself 
in serious development work must quickly learn to communicate with 
a variety of publics. In this regard, he will have to cultivate skill in 
dealing with the demands of the practical world while preserving his com- 
mitment to responsible scholarship. The niceties of extensive qualifica- 
tion, for instance, may be viewed as the work of a penetrating and precise 
intellect in scholarly discourse but would elicit judgments of indecisive- 
ness and weak commitment among decision-makers in the world of practice. 


Another point of debate concerned the ultimate goal of the Humani- 
zation Mission. In the early period of preliminary articulation there was 
no suggestion that the purpose would be the development of a signifi- 
cantly different model of schooling which would eventually be imposed on 
all Alberta schools. Shortly thereafter, however, a decision was made 
to view this development effort as leading toward an alternative model 
significantly different with respect to ends and means from present school- 
ing practices. This decision similarly was construed by some as reflect- 
ing loss of courage and commitment to a proposal for radical reform of 
existing schools (Gross, 1971). Radical reforms, in contrast to innovations 
of the experimental variety typifying efforts at school improvement to- 
day, have even suggested going beyond existing schools and have pro- 
posed reconstructions that amounted to de-schooling. Whether the com- 
mitment to the development of an alternative model of schooling is seen 
as a retreat from what some hoped would develop into a radical attack 
on existing schools is something for future students of the social and 
educational scene to judge. One is inclined to argue in any case that 
a proposal for shifting the locus of choice as to purposes and procedures 
increasingly toward the learner, as he avails himself of opportunities to 
grow, is in the present context of school thought and practice a departure 
of significant proportions. 


There is another point at which development staff will find itself at- 
tempting to reconcile inconsistent demands. Academic researchers as a 
group tend to manifest a thorough and reflective attitude to the systematic 
production of knowledge in keeping with their concern for intellectual 
rigor and defensible inquiry. People responsible for the conduct of prac- 
tical affairs, however, confront problems of increasing complexity that 
demand prompt attention and resolution. Hence, there will be a growing 
and insidious expectation of instant results on the one hand and the 
ponderous task of securing, applying and testing knowledge in a parti- 
cular arena of practice on the other. One thing is assured, and that is 
that the demands for visible products will come early and persistently. 


283 


J. O. Fritz 


One way in which the early stage of articulation of the Mission proposal 
was affected by these apparently inconsistent requirements occurred at the 
time that the invitational seminar was scheduled. The time chosen for this 
seminar was June, 1970, and its purpose was essentially to subject the 
Mission proposal to critical scrutiny and appraisal by the research com- 
munity. It was generally agreed that this first statement would have 
benefited considerably by further clarification and refinement of the es- 
sential themes. However, it was also clear that, unless some basis for 
the rigorous analysis and appraisal by “those who know” was established 
before the fall of that year, budgetary decisions were so scheduled as to 
preclude any possibility for support during the succeeding year to further 
articulation and refinement of the Mission rationale. One does not need 
to remind researchers how often they are faced with the necessity to re- 
quest and justify support for the next year’s research effort before the 
current year’s activities have brought forth sufficient evidence to merit 
continued support. Clearly, the researcher, committed as he is to the tenets 
of responsible inquiry, comes into stark conflict with the fiscal necessities 
which require appraisals of productive potential long before his research 
effort has had any opportunity to show what it can do. 


With respect to the adjudication processes on these three levels, the 
Humanization Mission effort encountered an interesting phenomenon that 
might be termed vetting by circular legitimation. To recall again the 
early history of the Humanization Mission, considerable risks were en- 
countered when only a rudimentary description of contemporary trends in 
curriculum change, shifts in research emphases in the social sciences and 
the implications for educational priorities was effected in the first “pro- 
spectus”. Time and resources were simply inadequate to give shape to 
a more substantiated document. Nevertheless, an advisory group of profes- 
sional educators extended initial encouragement and support for the hu- 
manization ideal. However, before the proposal could be vetted by respon- 
sible authorities in the Human Resources Research Council, it was to have 
been subjected to informed appraisal by research specialists in the relevant 
human disciplines. Support for the advancement of the Mission would 
clearly be contingent upon successful adjudication at this level. As it was, 
a less than adequate statement than could have been produced had to 
carry the burden of surviving critical analysis and judgment by scholar- 
researchers, which, in turn, became the important base for a decision 
by Council to grant or withhold support for the further articulation and 
refinement of the Mission rationale. A more thoroughly researched and 
polished statement of intent and justification would likely have fared 
better in this round of critical appraisal. Under such circumstances, vetting 
authorities must draw further confidence from the assessed capability 
and commitment of individuals whose task it would be to move a plan of 
high risk into subsequent stages of productive development. 


The Critical Play of Confidence 


Perhaps the most significant phase of productive effort occurred after 
the June seminar. A series of questions and problems were framed and 
categorized according to different theme areas and a group of select 
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specialists from the various disciplines were invited to address them- 
selves to these concerns. These questions or problems represented areas 
of ambiguity and matters of tactic and procedure for field application. 
A group of thirteen resource consultants in Sociology, Social Psychology, 
Educational Psychology, and Curriculum were invited to examine research 
and theory relevant to these questions and to speculate freely and cour- 
ageously about fruitful solutions or responses. Important here is the clear 
and precise identification of relevant questions and tasks and subsuming 
them into categories amenable to reflective response by research specialists. 
Also, it is critical at this stage to invite the “right” kind of resource 
specialist for such an engagement, individuals who express strong sympathy 
and fascination for the humanization effort, who are highly respected 
scholars in their own right, and who hold a pressing concern for the 
realities of current schooling and the need to foster significant changes 
in them. Consideration should also be given to the danger of acquiring 
a resource consultant with such awesome status or persuasive power 
that his own point of view might bend the subsequent charting of con- 
ceptual and developmental activities to unwarranted degrees. The need, 
essentially, is to obtain the best that is known in the way of more de- 
finitive and focused input, and it is the responsibility of project staff 
to assure that the relevant perspectives, both theoretical and empirical, 
are brought to bear upon the particular questions or issues then in view. 


Another source of psychic support emerged in the form of three reports 
from the task forces mounted by the Commission on Educational Plan- 
ning in Alberta (1971la; 1971b; 1971c¢). It was noteworthy to find that es- 
sentially humanistic concerns for the person of the learner and the need 
to enlarge his capabilities for self-direction and self-renewal loomed large 
throughout these reports. There is, however, a danger that new ideas and 
proposals may acquire authentification through what might be called cy- 
clical acknowledgement. It has become evident within the past few months 
that a given spokesman would cite person X as an authority for a state- 
ment about the humanization of the educative process and some months 
later person X would cite the first spokesman as his authority for the 
same point. This kind of reciprocating authentification may appear as a 
result of efforts to legitimize a new proposal or program. 


Within the past few years a number of converging, yet discreet but 
highly interrelated developments have appeared in schools on this con- 
tinent. All of these impinge at various points upon the basic themes of 
the Humanization Mission. The “free’’ schools movement on this continent 
is generally sympathetic with the essential tenets of Humanization. A fas- 
cinating exemplar is found in the Campbell River Secondary High School 
on Vancouver Island which had introduced a seemingly innocous innovation 
by providing students the option to attend or not to attend classes. All 
other requirements are characteristic of the traditional, centrally guided 
if not directed, school system. Nevertheless, highly significant influences 
and alterations have become apparent in the behavior and attitude of 
professionals and learners alike within the school. Such expanded learner 
choice and the exercise of responsible decisioning are clearly indigenous 
to one of the central themes of Humanization. In addition, some exciting 
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work is being done in the area of values and their treatment in Social 
Studies curricula (Alberta Department of Education, 1970), the injection of 
feeling and fantasy into learning activities (Jones, 1968), the calculated 
emphasis on the “here and now” (Alschuler, 1970), a concern for improved 
human relations in the classroom (Lopatka, Henders, and Con, 1970), and 
the pedagogical application of achievement motivation training in educa- 
tion (Evans, 1971). One school innovation in Alberta of fairly substantial 
proportions has been grounded also upon humanization themes and serves, 
additionally, to reinforce the practical prospects of the Humanization 
Mission (Bliss, 1970). 

To be sure, it is no handicap to an endeavour such as the Humani- 
zation Mission when a highly renowned and respected psychologist such 
as Bruner (1971) expresses some serious personal reservations about his 
previous commitment to the “structure of knowledge” as a principal basis 
for new curriculum developments. He now allows that such important 
influences as social class and inner personal struggle need to be repre- 
sented prominently in any reconstitution of schooling practices. Even more 
surprising is his recognition of the importance of the “here and now”. 


What is important is to learn to bring all one’s resources to bear on some- 
thing that matters to you now. These are the times for the migratory 
questions that wander on long after their answers are forgotten, just be- 
cause they are great questions. And there must be more time for the ex- 
pressive elements — the encounters, the hates, the loves, the feelings. 
All this need not be antic nor need it all be in the manner of presenting 
one’s case (p. 20). 


In his own words, Bruner reveals how much he has moved in the direction 
of the humanization ideal: 


I believe I would be quite satisfied to declare, if not a moratorium, then 
something of a de-emphasis on matters that have to do with the structure 
of history, the structure of physics, the nature of mathematical consistency, 
and deal with it rather in the context of the problems that we face... . 
We might put vocation and intention back into the process of education, 
much more firmly than we had it there before (Italics in original) (p. 21). 


Indirectly, Bruner is implying that the initiative to learn and the desire 
to learn, if they will eventually be translated into energetic thrusts on 
the part of the person, must be ignited through more personalized con- 
cerns involving the learner’s immediate and ultimate goals. 


The Humanization Mission is essentially a curriculum development ef- 
fort which is opting for an alternative set of educational priorities and 
processes to enhance and vitalize continued learning encounters. As such, 
it must draw upon whatever is confidently known in related disciplines 
and specialties. Its processes must, of necessity, be “eclectic”, in the sense 
that it must employ ‘“‘arts by which a usable focus on a common body of 
problems is effected among theories which lack theoretical connection” 
(Schwab, 1971, p. 10). Schwab postulates further: 


There is no foreseeable hope of a unified theory in the immediate or middle 
future, nor of a metatheory which will tell us how to put those subjects 
together or order them in a fixed hierarchy of importance to the problems 
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of curriculum. What remains as a viable alternative is the unsystematic, 
uneasy, pragmatic, and uncertain unions and connections which can be ef- 
fected in an eclectic (1969, p. 10). 


The “Arts of the Eclectic” are just now receiving systematic attention 
and early indications suggest that the role of the developer will be a 
highly demanding one both in forging the necessary linkages among the 
various theoretical inputs as well as in devising effective strategies of 
intervention (Schwab, 1971). In the meantime, the generalist in education 
who seeks to initiate a developmental program such as the Humanization 
Mission finds himself in a delicate game of professional brinkmanship 
wending along a precariously thin line that separates persuasive exhor- 
tation from warrantable advocacy. 
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Social Science and Social Progress, 1971: 
An Assessment and a Prognosis 


The critical examination to which research and development activities and 
agencies are being subjected ts taken as a point of departure for reviewing 
historical developments and persistent problems in both approaches and 
institutions, Two general types of problems encountered by research agencies 
are identified as capability problems and credibility problems, Persistent 
capability problems reside in the inadequacies of knowledge bases, of con 
ceptions of the research and development process, of policy research, and 
of auditing devices, Credibility problems relate to the difficulty of esta 
blishing and maintaining effective relationships with scholars, policy-makers, 
client institutions, and the subjects of social research, It is suggested that 
among the needed developments for the future are better techniques for 
mobilizing, utilizing, and controlling the resources of social policy research, 


The lavishly-funded movement in research and development in educa. 
tion and other social services which began in the United States in the 
mid-’fifties, gained momentum and spread to Canada in the ‘sixties, 
appears now, in the early ‘seventies, to be in serious jeopardy, The 
movement, it is claimed, simply has not lived up to its promise, Mducation 
and other institutions of society have not been reformed and revitalized 
as expected. 

Not surprisingly, this year, the budgets of most R and D agencies 
have been reduced. The movement has come under critical re-examina- 
tion. And R and D has been asked to demonstrate (as research has 
seldom, if ever before been required to demonstrate) that its benefits 
to society warrant its costs to the taxpayer, 


Rasy explanations of this unfulfilled promise have come from various 
sources. Some observers claim that the potential of the social sciences 
as instruments of social improvement were grossly overestimated in the 
first place. After all, these fields of knowledge were and still are com. 
paratively young; to expect them to generate sufficient knowledge to 
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solve the problems of a complex society was to set an unrealistic expecta- 
tion. Others contend that the linkages required to make research and 
policy or research and practice complementary to each other have not 
yet been established and are not likely to be. After all, the world of the 
practitioner and politician is essentially an intuitive, non-scientific world; 
to expect such action-oriented persons to become the bedfellows of theory- 
oriented social scientists was again to set an unrealistic expectation. Still 
others argue that the movement has not yet been given sufficient time 
to prove itself. It took more than a few years of research and develop- 
ment to build the atomic bomb or to send a man to the moon; surely 
the problems of ignorance, poverty, urban decay and the like are just 
as difficult and time demanding. And so the process of rationalization 
goes on. 


But after all of these easy and perhaps partially accurate explanations 
have been heard, the difficult questions remain: What, if anything, has 
gone wrong? Were there false expectations? Or miscalculations? Can 
the social sciences really contribute significantly to social progress? How? 


Rand D in Historical Perspective 


The origins of the R and D movement on North America can be 
traced to the project research in the fields of agriculture, medicine, 
defense and to some extent, education which received increased support 
from foundations and governments in the early ’fifties. Most of these 
projects were conducted by individuals or small groups who were en- 
couraged, through grants, to attack problems of their own choosing. This 
research effort was largely curiosity-inspired. Hence, it tended to be 
fragmented and non-cumulative; it was frequently seen as irrelevant by 
policy-makers and practitioners; and it tended to widen the gap which 
already existed between the discovery of knowledge and the use of 
knowledge. 


So in the ’sixties a systems view and a mission approach came into 
vogue. Under this approach, research was to become cumulative, pro- 
grammatic, and problem—or development—inspired. More important, it 
was to get linked in an operational way with invention, with testing, 
and with the installation of the new policies and practices which it 
Spawned. 


Quickly it became apparent that no existing institution was geared 
to this mode of operation. So governments moved to create new institu- 
tions. The United States government established a number of R and D 
Centres as adjuncts to existing Universities and a number of Regional 
Laboratories to plan, manage, and mobilize resources for a major R and 
D venture in education. In addition, support was increased for the 
several policy research institutes that were concerned with relating social 
research to the process of social policy development. 

Some Canadian provinces followed this lead—at least in a token 
fashion. Ontario set the pace with the establishment of the Ontario 
Institute for Studies in Education.-Alberta followed with a more broadly 
mandated institution—the Human Resources Research Council. Others 


290 


Social Science and Social Progress 


established centres more or less apart from government and more or less 
affiliated with Universities. 


A number of important assumptions underlay these developments: 
first, that the effective conduct of R and D ventures would require a 
host of complementary talents—academics of many disciplines, developers, 
field testors, policy-makers, and practitioners; second, that operational 
linkages would have to be established among the various agencies— 
universities, educational systems, departments of education, teachers’ asso- 
ciations, and so on; and finally, that a new agency would be required 
to perform the new role of research planning and management, of 
mobilizing resources, of maintaining inter-institutional linkages—in short, 
of mission planning and control. 


Some of these agencies have now been in existence a decade or more. 
Others are of more recent origin. All of them, along with the idea that 
led to their creation, are now under review. What difficulties have they 
encountered? How and how well have they coped with these difficulties? 
How might they be strengthened? What is their future? 


Persistent Problems in R and D 


The problems that are typically encountered by any new R and D 
or policy research agency are of two general types: problems that have 
to do with its capability—its command of the knowledge, tools, tech- 
niques, and strategies which are involved in its operations; and problems 
that have to do with its credibility—the position of esteem or otherwise 
which it holds in the eyes of those whose cooperation it requires to get 
on with its job. 

Of course these two types of problems are closely related. Indeed, 
one can often be the cause of the other. Any research agency that 
fails to develop a capability is likely to have difficulty maintaining 
credibility with its clients. Similarly, any research agency that lacks 
credibility is likely to have difficulty mobilizing a capability. 

Nevertheless, it may make sense to examine certain persistent prob- 
lems in the context of this general distinction. 


Capability Problems 


1. Inadequate Bases of Knowledge 


The store of knowledge upon which R and D in the social domain 
has attempted to build, has proven inadequate in two major respects. 
First, it has proven to be so fragmented that general theorems and 
broad conceptual systems (necessary starting points for R and D) have 
not been forthcoming. Second, since the knowledge that has been gen- 
erated in the social sciences has been so largely of the descriptive and 
normative variety, R and D has lacked the “operational knowledge” 
required to move from questions of “what is” and “what ought to be” 
to question of “how to do what ought to be done.” 

The fragmentation that characterizes knowledge in the social domain 
can be explained partially by the attitudes that social scientists have 
adopted with respect to theory-building and by the kind of empiricism 
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that has characterized most social research. Social scientists tend to 
reject grand theories; they prefer to work with mini-theories, no theories, 
or so-called “theories of the middle range.” Seldom do their theories 
transcend the boundaries of a single discipline in such a way as to 
interrelate the perspectives and principles of several disciplines—even 
when these theories involve common phenomena. Their methods and the 
data they generate are correspondingly fragmented and difficult to put 
together into the kind of a base-line of knowledge which is required 
for the initiation of systematic programs of R and D. 


What is needed to correct this situation are general theories or 
conceptions of social systems—conceptions which inter-relate all the social 
science disciplines and make it possible to connect knowledge gen- 
erated by one field with knowledge generated by others. Before this need 
will be met senior social scientists must dare to venture beyond the 
boundaries of their own disciplines (as some are beginning to do) and 
seek to establish systems for relating their knowledge and insights to 
those of other scholars. Such “generalists” in the social sciences could 
serve R and D missions by providing the codifications of knowledge 
which would become the baselines upon which mission planners might 
build. 


The scientist’s typical disregard for operational knowledge is some- 
what over-stated by the story of one “expert” who, when asked for his 
advice as to how to cope with the U-Boat menace in the Atlantic during 
the World War, glibly advised: 

“Boil the Atlantic.” 


When asked how one might accomplish this remarkable feat, he 
replied: 

“How to do it is not my business. That is the problem for the engi- 
neers and administrators.” 


Recent studies of the processes of change have begun to shed some 
light on operational questions. But in much of the R and D work cur- 
rently underway, the change and implementation aspects of the process 
are typically turned over to practitioners and not properly studied by 
scientists. Granted, practitioners do, through experience, develop intui- 
tion, instincts for what will work and what will not in the innovative 
process. But through these techniques, knowledge does not accumulate. 
Each innovator proceeds “‘to re-invent the wheel.” 


2. Inadequate Conceptions of the R and D Process 


Conceptions of the R and D process have been of two general types. 
One of these, the one typically espoused by social animators, rests on 
an assumption that there is, within society and its various institutions, 
sufficient knowledge and expertise to support a continuous process of 
self-renewal—if only this knowledge and expertise could be activated and 
directed toward proper ends. Grass-rootism, self-analysis, and the staff 
project are the preferred methods of innovators who adopt this model. 


Models of the R and D process, resting on this assumption, take a form 
such as the following: 
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Need 
Ve aN 
Monitoring Objective 
and Feed-back Setting 
Implementation Conditions 


Ne Assessment 


Plan and Strategy 
Development 


At the other extreme is a conception, the one typically adopted by 
researchers and bureaucrats alike, which rests in the assumption that 
change is anathema to individuals and institutions and, hence, that the 
application of new knowledge to practice must be contrived or engi- 
neered by an outside agency. 


Models resting upon this assumption take quite a different form: 


Research 


on 


Feedback Development 
and Invention 


Diffusion and 
Re-training Field Testing 


pen na 


There are marked differences between these two conceptions. In the 
latter, the assumption is that something is to be done to the client 
system; in the former, the assumption is that the client system is to do 
something for itself. In the latter, there is a hint of manipulation of 
a less knowledgeable agency by a more knowledgeable one; in the former 
there is a suggestion that knowledge and expertise can be sacrificed, if 
need be, in the interests of participation and involvement. 

Clearly, neither of these models is adequate to guide a scientifically 
based, systematic and sustained program of R and D. What is needed 
is a combination of these and other concepts into a comprehensive con- 
ceptual framework of the process. What is further needed is empirical 
testing of the model to provide the “operational knowledge” referred to 
earlier. 


3. Inadequate Conceptions of Policy Research 


It is generally assumed that research can and should provide the 
basis for both “incremental” and “reconstructive” change in the institu- 
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tions of society. Incremental change is usually thought to be the likely 
outcome of the process of R and D. Normally, it proceeds on the as- 
sumption that the institution (the school, the college, or whatever) is a 
“given”: the goal is to effect change within the existing institutional 
context. 

Reconstructive change is usually thought to be a more likely outcome 
of policy research. Unlike R and D, policy research proceeds on the 
assumption that existing institutions and programs are not “givens.” It 
aims somewhat higher—at policies rather than the programs or institu- 
tions through which policies are implemented. Recommendations for re- 
constructive change are the expected outcomes of such studies. 


Current conceptions of policy research—along with the methodologies 
adopted by those who conduct it—are singularly primitive and unreliable. 
Most so-called policy studies simply do not contribute greatly to the 
development of social policy, for their recommendations are seldom 
heeded. And when they are, the consequences are as often disastrous 
as they are helpful. 


Why? What are the major shortcomings of contemporary policy re- 
search? 


First, in much of what sells as policy research, there is little or no 
relationship between the empirical data (with which all policy researchers 
begin) and the evaluative statements and recommendations (with which 
they all conclude). This seems to suggest that policy research has a kind 
of seductive quality, probably having to do with its proximity to power, 
which encourages researchers to go beyond their knowledge and make 
recommendations which come strictly “off the top of the head.” 


Second, most policy researchers tend to deal in single prescriptions 
rather than alternatives. They tend to recommend rather than hold out 
possibilities. In any given case, the recommendation may be formulated 
primarily on economic grounds, or social grounds, or educational grounds, 
or the value preferences of the researcher, or whatever. But when the 
policy-maker comes to deal with the recommendation, some other con- 
sideration may be of primary concern to him. So he may have no alterna- 
tive but to reject the recommendation. In short, too many researchers 


leave room for the policy-maker to maneuver and exercise his own 
judgment. 


Finally, policy researchers have not yet learned how to specify the 
likely impacts of various alternatives—how to provide the policy-maker 
with material to consider as he weighs the pros and cons of the pos- 
sibilities identified. What is needed, of course, are techniques for sim- 
ulating various conditions, conditions which correspond with the various 
alternatives, and for assembling data in such a way as to clarify the 
consequences, intended and unintended, of various choices. 


4. Inadequate Auditing Devices 


The tools that the social sciences have developed for monitoring social 
change and for assessing the impacts of planned interventions are quite 
unequal to the needs of R and D agencies. Social scientists have typical- 
ly sought to experiment in controlled situations, in which the object 
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is to observe and describe the relationship of one variable to another. 
In R and JD, situations are not controlled. Concern must be for a total 
system—not a single pair of variables. 


What is needed for the effective monitoring of R and D programs 
is a monitoring and evaluation scheme based upon a systematic view 
of all of the phenomena and all of the activities involved in the mission. 
Given such a view, it should be possible, in time, to develop compre- 
hensive monitoring instruments for taking stock of states-of-affairs at 
various points in time. Some of the more recent attempts at social account- 
ing and institutional stock-taking appear to have promise. But a good 
deal of refinement and instrument development will be required before 
they begin to meet the need. 


Credibility Problems 


As serious as and closely related to the problems of building research 
and development capabilities, is the R and D agency’s difficulty of 
establishing and maintaining credibility with the variety of institutions 
and individuals with whom it must collaborate—the university scholar, the 
policy-maker, the client institution, and the subjects of research. 


1. Credibility Between the Developer and the Research Scholar 


One of the most popular and powerful concepts to emerge over the 
past few decades has been the concept of “mission-oriented research.” 
The mission approach to research planning and management has been 
credited, for example, with the successes of the American space program 
in sending men safely to the moon and returning them to earth. So it 
has been assumed that such an approach could be used to enhance the 
effectiveness of any problem or policy-oriented research agency. But 
there are difficulties in the approach. 


In the planning of mission research, one sets a goal or a target 
(landing on the moon) and then very carefully plans all the activities 
(filling gaps in knowledge, inventing needed instruments or technologies, 
developing required materials, training specialized personnel, and so on) 
required to achieve the goal in a minimum of time, with minimum 
chance of error, and with a minimum expenditure of resources. 


The important thing is that each activity in the program must be 
incorporated as a part of a master-plan—each activity as a consequent 
of an earlier activity and the antecedent to a subsequent activity. Hence 
there must be some kind of mission control, some mechanism for en- 
suring that all activities are appropriately designed, carefully scheduled, 
and integrated into the master-plan. 

And that is the source of difficulty. To ensure that each activity or 
project is effectively conducted, the organization must attempt to 
attract to the project the most expert talent available. Such talent is 
typically found in scholars who have developed their expertise in the 
university setting and who have adopted the university’s posture with 
respect to research: creative, theory-based inquiry in an environment 
of complete academic freedom. 


295 


L. W. Downey 


Many scholars are inexperienced in mission research. They are sus- 
picious of the term. The concept is anathema. So the dilemma emerges: 
how can the individual scholar be allowed to follow his own creative 
instincts or the emerging theoretical underpinings of his field when the 
goal of the organization is to resolve a specific set of problems, to 
achieve a specific mission? 

First, the planners of research missions and the prospective doers of 
research cannot be expected or allowed to work independently of each 
other. Only when there is a satisfactory merger of the two specialized 
talents can it be ensured that missions will be properly designed and 
that specific activities will be properly conducted. 

Second, it should not be assumed that mission research planning or 
management is always anathema to all scholars. On the contrary, when 
the orientation is judiciously imposed and its benefits expertly demon- 
strated, it has a good deal of appeal to some academics—particularly to 
the confident, seasoned scholar who “knows damn well” that he is 
academically free, but feels little compulsion to reassert the point; and 
to the so-called “new breed” of social scientist who is interested in con- 
tributing, not only to the literature of his field of study, but also to 
the improvement of the society that he studies. 


2. Credibility with Policy-Makers 


When governments create and sponsor research agencies, they tend, 
logically enough, to regard such agencies as their servants. They like 
to think of the agency as the problem-solving, research arm of the 
government. Hence, they expect it to be sensitive to government’s needs, 
to solve government’s immediate problems, and to concern itself with 
whatever things concern the government. 


This view is quite understandable. Politicians tend to live day-to-day 
existences. They realize that unless today’s problems are satisfactorily 
resolved there may be no tomorrow. Hence, their concerns tend to be 
with the immediate rather than the long-range. It is also a fact that 
problems are frequently defined by policy-makers in rather narrow terms; 
sometimes it is the symptom rather than real issue that is identified; 
and as often as not, the problem is framed by policy-makers in terms 
that make it unmanageable to researchers. Finally, the politician’s prior- 
ities are not likely to be the same as those of the research agency. 
The first concern of the politician is, and must be, to stay in office; 
the goal of the research agency is to inquire into the nature and causes 
of society’s problems. With two such different perspectives, the politician 
and the researcher are likely to disagree from time to time on what is 
important and what is unimportant. 

But there is another side to this issue. Many politicians do, in fact, 
develop a high level of insight into social conditions; the instincts of 
many politicians are very good indeed. The views of such insightful, in- 
tuitive policy-makers can be most useful to the research agency as it 
shapes its goals and programs. 

In addition the research agency’s very existence and the support it 
receives depends, in the final analysis, upon its capacity to resolve prob- 
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lems, to inform the process of social policy development and, hence, to 
have real relevance to policy-makers. So, if the research agency persists 
in taking on problems that are not seen as problems by policy-makers 
or in recommending policy changes where policy changes are not being 
contemplated, then the agency will become known for the irrelevance 
of its work. And it will find itself out of favor with those whose support 
it requires for its existence. 


In light of these considerations, research agencies, if they wish to 
maintain credibility, are well advised to engage in three major types of 
research—defined in terms of their proximity to the process of social 
policy development: 


First, independent research projects which are initiated, designed and 
conducted without any collaboration with or approval from another 
agency. They may be evaluative, descriptive, or experimental. They may 
be theory-based or problem-inspired. They may be calculated to add new 
insights to an issue of continuing public concern or to jolt the public 
conscience with an exposé of an undesirable condition and alternative 
strategies for its correction. In any case, such projects establish the 
research agency as one which is, in part, autonomous and self-directed, 
quite capable of setting a major portion of its own mandate and of 
living with the consequences of its actions. 


Second, jointly planned research and development missions, the im- 
petus for which may come either from the research agency or from a 
prospective client group. In either case they are designed in close com- 
munication with those agencies whose cooperation is required for the 
successful conduct of the project. Such projects identify the research unit 
as an agency which works shoulder-to-shoulder with policy-makers, plan- 
ners, and practitioners for the improvement of policy and practice. 


Third, requested studies, which are usually evaluative or planning 
studies of the so-called “quick and dirty” variety. They are initiated 
at the request of a client agency. Such studies establish the research 
agency, in part, as a stand-by evaluation and research capability for 
policy-makers and practitioners. 


3. Credibility with Client Institutions 


The major cause of the credibility gap with client institutions is a 
fundamental difference between the inclinations of the researcher, on the 
one hand, and the practitioner, on the other. The researcher is inclined 
to search for certainty—to know what he knows for sure; the practitioner 
is inclined to act on the basis of the best knowledge available—sup- 
plemented by his intuition and judgment, acquired through experience. 
Hence, there is frequently a natural suspicion of each other, not con- 
ducive to effective collaboration. 


Closely related is a second difficulty having to do with the basic 
differences between the process of institutional change and the dis- 
covery of knowledge. Institutional change is a continuous process; it 
is characterized by incremental modifications in procedures and by the 
gradual adjustment of affected persons to such change. The discovery of 
knowledge, in contrast, tends to occur in spurts; findings simply become 
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available as studies are completed. The abrupt, unanticipated jolts that 
new research findings can sometimes give to the management process 
become dysfunctional. The manager’s inclination is to move deliberately 
and gradually to integrate the new knowledge into evolving practice; 
the researcher, however, eager to have his contributions recognized, may 
be inclined to attempt an “end run’, to short-circuit the process by moving 
his inputs closer and closer to the top of the policy-making hierarchy. 
When this maneuver fails, as it usually does, the researcher, the 
practitioner, and the policy-maker have further cause to distrust one 
another. 


Still another difficulty in research and development endeavors in this 
country is what OECD observers have referred to as the “ecological 
difficulties of development.” The reference here is to a void, a condition 
of inaction and non-support for the activities that are required to link 
policy to research, action to knowledge. 


This observation has substance. Very few social service delivery systems 
in this country make any kind of provision for development activities— 
inventing new methods or testing innovations. Few private enterprises 
have chosen to gear their operations to the commercial development 
of the instruments of change in social services. And few universities or 
other research agencies move beyond pure and applied research to the 
development of the tools and materials of implementation. In short, 
development capital has been in very short supply. 


Given this state of affairs, the new research and development agency 
may see no alternative but to attempt to carry all aspects of the re- 
search and development itself—to conduct the required research, to invent 
the instruments of implementation, to retain practitioners, and to develop 
the required materials. But when this course is followed, all sorts of 
problems are generated: (1) total responsibility for the conduct and the 
cost of the activity rests with the research and development agency— 
an awesome burden and a hazardous commitment; (2) the client or- 
ganization tends to become passive and dependent—to adopt a “change 
me if you can” attitude; and (3) the research and development agency 
tends to be viewed as something of a “pork barrel” by client agen- 


cies—all manner of fringe benefits may be exacted as the price of 
collaboration. 


In such cases, the R and D agency tends to create unrealistic expecta- 
tions, albeit unwittingly, and when it backs away, as it inevitably must, 
its credibility suffers correspondingly. 


4. Credibility with the Researched 


Finally, it should be noted, that research agencies encounter serious 
problems in maintaining their credibility with the persons and institutions 
who become the subjects of research. Native peoples, the poor, welfare 
recipients, and other like groups claim that they have been “researched 
to death” and they have begun to resist researchers. Similarly, schools, 
hospitals, correctional institutes, and so on claim that their work is 
seriously impeded by the questionnaires, interviewers, and observers that 
research agencies impose upon them. 
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Such negative attitudes on the part of the researched can be ex- 
plained on several grounds: (1) Seldom are the guarantees of con- 
fidentiality adequate; hence, the subject, reasonably enough, chooses to 
protect his right to privacy in his own way—by declining to cooperate. 
(2) Frequently, the potential use of the research is not made clear to 
the subject; hence he acts in his own way to protect his time—by de- 
clining to cooperate. (3) Often too, there is little if any feedback from 
the researcher to the researched; hence, the individual or the institution 
is again inclined to act in his own way to avoid being “used.” 


Clearly, this is a problem of research ethics. To disregard the 
rights of subjects to personal privacy, to an understanding of the pur- 
poses of research, or to a share of the products of research, is, at best, 
to regard them simply as “guinea pigs.” From a purely ethical point 
of view, this must be condemned as shoddy behaviour. From a practical 
research point of view, it must be condemned as the kind of action 
that destroys the laboratories in which social scientists must work. 


The Future 


Given the host of problems identified here, most of which remain 
unresolved or only partially resolved, one must ask: What hopes can one 
have for the future? Can social policy research and/or the process of R 
and D be brought to the service of social policy formation and to the 
resolution of society’s critical problems? Or to put it another way: Can 
the kind of “quasi non-governmental research agency” that has recently 
been created to perform that role ever hope to perform its role effec- 
tively? If so, under what conditions? 


It seems clear that, if these efforts are to succeed, better techniques 
must be found for mobilizing, utilizing, and controlling resources. To 
mobilize effectively is to reach out into many institutions of society and 
attract the appropriate talents; to utilize effectively is to plan and co- 
ordinate activities in such a way as to make talents complementary to 
one another; to control is to impose the kinds of constraints that are 
needed to prevent individuals from attempting to make contributions 
which they are incompetent to make. 

The skills and talents that are required to orchestrate such a ven- 
ture are difficult to find or develop. But to do so, is the first major 
task of the R and D agency. 

It seems clear also, that if the movement is to succeed, codes of 
behaviour must be developed to guide the complex web of inter-institu- 
tional, inter-disciplinary, and inter-personal relationships that are in- 
volved in R and D. 

The skills and talents that are required to orchestrate such relation- 
ships are also difficult to find or develop. But to do so, is undoubtedly 
the second major task of the R and D agency. 


Can it be done? It simply must. 
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SOCIAL FUTURES ALBERTA 1970-2005 


This report summarizes the results of six forecasting exercises. The 
topics covered in these exercises are as follows: future changes in values 
and social goal orientations, future of the family, leisure and recreation 
in the future, intercultural relations in the future, the future of politics, 
and future needs and problems of the individual. These topics were 
selected for their relevance to the future of education, though their 
implications extend far beyond education. This study was conducted 
by the Westrede Institute under the direction of Harold J. Dyck, with 
special assistance from George J. Emery. Price, three dollars. 


ECONOMIC AND DEMOGRAPHIC FUTURES IN 
EDUCATION, ALBERTA 1970-2005 


This study considers probable levels in distribution of Alberta’s popula- 
tion from 1970-80 and from 1980-2005, and explores the implications of 
these population data for enrolment at various levels of education. Also 
considers the growth potential of the Provincial economy, its implications 
for Provincial Government revenues, and the relationship between these 
revenue projections and potential educational costs. By Don Seastone. 
Price, five dollars. 


THE FUTURE AND EDUCATION, ALBERTA 1970-2005 


This is the last in a series of studies on the future of Alberta, and 
of education in Alberta, published by the Human Resources Research 
Council. Background work which led to the publications was _ under- 
taken by the Human Resources Research Council with the support of 
the Commission on Educational Planning. “Social Futures Alberta, 1970- 
2005” and “Economic and Demographic Futures in Education, 1970- 
2005” are two other publications in the series. This last study surveys 
some of the major findings of those which preceded it, analyzes their 
social implications, and proposes some educational responses. The study 
was written by Dr. Harold S. Baker, with the assistance of members of 
the staff of the Human Resources Research Council. Price, three dollars. 


SOCIAL GOALS, EDUCATIONAL PRIORITIES, AND DOLLARS: 
PLANNING EDUCATION IN THE SEVENTIES 


Proceedings of the Conference on Educational Planning sponsored 
by the Alberta Human Resources Research Council and the Canadian 
Council for Research in Education, October 18-21, 1970. Includes papers 
on Social Research and Public Policy, The Need to Plan, Contemporary 


Approaches to Planning in Education. Edited by J. A. Riffel and E. Miklos. 
No charge. 


EDUCATIONAL PLANNING REEXAMINED 


This monograph offers a comprehensive survey of educational plan- 
ning as it has been and as it. might be. The author states that “my 
concern is with characterizing educational planning, not as it has been, 
but as it can become.” Major topic headings include: Lessons of the 
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Last Fifteen Years; Toward an Optimal Model of the Planning Process; 
The Influence of Circumstances and Ideologies on Education Planning; 
Improving Resource Allocations in Education; Linking Education Planning 
and Social Forecasting; Fitting the Pieces Together—The Possibilities for 


‘Second Generation’ Planning in Education. By J. A. Riffel. Price, five 
dollars. 


RESEARCH REPORT—A REVIEW OF EDUCATIONAL 
OPPORTUNITY, ALBERTA, 1970 


Early in 1971, the Human Resources Research Council sponsored the 
preparation of a series of resource papers on various aspects of life in 
Alberta. One of the papers in this series, written by E. J. Ingram and 
L. W. West, examines the state of educational opportunity in Alberta 
as it was in 1970. The report is divided into four major sections en- 
titled: ‘““The Assessment of Opportunity”; “A Review of the Educational 
System”; “Additional Data Needs”; and “Policy Issues”. Topics dis- 
cussed by the authors in the report include: present modes of assessing 
opportunity; emerging trends in educational thought and policy; in- 
dicators of educational opportunity; and a review of the educational 
system (from kindergarten through post-secondary) in terms of institu- 
tions, programs, enrolment and costs. Price, one dollar. 


Available from 
HUMAN RESOURCES RESEARCH COUNCIL 
11507 - 74 Avenue 
Edmonton 62, Alberta 
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NOTICE TO READERS 


The Alberta Journal of Educational Research is published in March, 
June, September and December, by the Faculty of Education, The Univer- 
sity of Alberta. 

Subscription Rates: 


CONG CAliaiies bai teehee ra snsky $ 5.00 


Back issues of the A.J.E.R. are available from the Editor at the 
following rates. The prices quoted are for unbound volumes. 


WUTC NUS A eh igeght eg wit Mae 3! 1 Rn $25.00 per complete set 
or $ 2.40 per single volume 

RSM YOUS IY LG eer. dics seavactnccess cece $22.50 per complete set 
or $ 5.00 per single volume 


An abstract of Articles published in the A.J.E.R. between 1955 and 1965, 
is available at $2.00 per copy. 


SUBSCRIPTION ORDER 


The Editor, 

The Alberta Journal of Educational Research, 
839 Education Building, 

The University of Alberta, 

Edmonton 7, Alberta. 


tional Research, for the period of .......... year(s). 


I understand that my subscription will commence with the March 
issue and will conclude with the December issue. 
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BACK COPIES ORDER 


The Editor, 

The Alberta Journal of Educational Research, 
839 Education Building, 

The University of Alberta, 

Edmonton 7, Alberta. 


Please supply the following back issues of the A.J.E.R. 


A. Vols. 1 through 11, at $25 per set. No.of setsinequired strrccmect eat 
Individual vols? required) .c,g.cc-.sc neat ete achete eee Number.of copies... hte 
B. Vols. 12 through 16, at $22.50 per set. Novrequired acs: ee 
Individual vols. required <1... erase eae Numbenol coprescs.-<: eae 
C. Abstract of articles at $2.00 per copy. No. required ....... iB ecereeatey ecetneeo 
Amount, of. cheque enclosedi.ic ches eter eeenee es eee 
Names sce dean hal elt eth reac Stead eta ee tee pa ceeerone eevee nee (please print) 
Addvess: :sctd Te. k ee oe ee 
costculdsbdut dics Be he uslaluases wes nhechease nt ekges VERE: arent net te ee ee Postcode; 24. ere 


CHANGE OF ADDRESS 


The Editor, 

The Alberta Journal of Educational Research, 
839 Education Building, 

The University of Alberta, 

Edmonton 7, Alberta. 


Please change my address from that shown on the enclosed mailing label to 
the following new address. 


Attach old mailing label 
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INTERCHANGE: A JOURNAL 
OF EDUCATIONAL STUDIES 


Interchange, a quarterly journal of The Ontario Institute for 
Studies in Education, is concerned with relationships among 
theoretical perspectives, empirical research, and educational 
practice. 
Special Issue on Early Learning 
Vole2; Nox 


GENERAL ISSUES IN EARLY LEARNING 


Thomas J. Ryan Poverty and Early Education in 
Canada 


Jerome Kagan Pre-School Enrichment and Learning 


Gaston Mialaret Le Role de l’Education Prescolaire 
dans |’Education Permanente 


REVIEWS OF SELECTED AREAS 


Eveline Omwake Pre-School Programs in Historical 
Perspective 


Solveiga Miezitis The Montessori Method: Some 
Recent Research 


J. W. Staines Assumptions Underlying Programs for 
Cognitive Growth in Australian 
Pre-Schools 


PROJECT REPORTS 


Burton L. White An Analysis of Excellent Early 
Educational Practices: Preliminary 
Report 


M. B. Karnes, A New Professional Role in Early 
J. A. Teska, and Childhood Education 
R. R. Zerbach 


William Fowler A Developmental Learning Strategy 
for Early Reading in a Laboratory 
Nursery School 


Robert H. Ennis Conditional Logic and Primary 
Children: A Developmental Study 


Annual Subscription Rates: Students—$3.00; other individuals 
—$5.00; libraries—$7.00. Single issues—$1.75 each. 


Remittance is requested by cheque or money order payable 
to OISE. Mail to: Publication Sales, OISE, 252 Bloor Street 
West, Toronto 5, Ontario, Canada. 


- iy 
eee | 
i at: Pied roan 98 A Suet se 


UF 


. 
a | 
¥ 
xy 
¢ 
; 
} 
' 
. * bw 
. 
rien hd 
ai. 
, a j 
Le 


o he 
ei iad 


eh 
Ere 


1S & AF 


athe, a a 


wine 


\ ae | 


rr? 


P 


ay 


“a omni cate 
a if 
fi weiss > ioe “yt! 


cLblye roth AER. st inal Jautth 
hie’ Lg ores ode 


eed ’ 


thodung: 


aA ad =| 

hi i 5 «., yagi 
¥ ; 2 
.' { a adts v 


i res et 
, SAL . 
‘ or? 
i 
beae e. <a" 
ss yn} erat , 
in “ 


yo ee he ee 
ie 4 iw 
yi 4 i? 
) A 4 ee” : p re. 
ciG why wat k 2 Ae 
ne ; a4 li * Br 3 ty 
if it H ' 
ie 5 Ede 4 againid 
ae 
Hy ’ ‘ wil & =) 
’ mB a 
LAWN TOM . 


es Otay ert cd sitet Jnor 


wh ivi aA i ree 
‘eta ht). 3. nei, vd A 
touts 


hy aye ahi A 
bes 


® 


val 


| POT 7) 
ray Sa ciel 


Wi | = rr re 
“| sf lane hs! La 


famag cry boi? pe 


tae 
aA be ‘Ln i ge) 


pe 


~S 


a | ; : 
Pee Rs Lie 
i : 7 Pe 2 ' 


Air aa 
fy e wis ¢ oh shee a 
7 ee vA Wi ie A 2) Niet 


ay ‘Vive ; », 


F ‘ 4 re i‘ ) : ih y ay) 
t nh ‘ cae <i ie ut oa . 
2] ji AS me 


: r i. h i 4 ir i 
Te ; : Hy i gy f ib a ne (a " 
; iy ae is At, | 


cs ‘uf 


il a ; 


-* 


rT i 
at 
‘1 q 


5 


soy ots Pacaeanneiticehmerte tt 
cicenvats betas hie fe & 
Spare Sah 


on 
beanie AR Se 


ha ms ih 


i es 


SPA 


=: 


Rae 


ee Cit re 


py. 
ie 
iy 
Ton 


ny y i hee 

i ee cee ty 
a aes } 
ote) ie 


Nant 
Rates 


